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ABSTRACT 

Contained here are the technical appendices to the 
report on Project LONGSTEP^ methodology and firdings. The general 
emphasis of Project LONGSTEP was on the identification of changes in 
student achievement that occur' as a result of intensive educational 
innovation. Its primary purpose was to analyze overall differences in 
achievement growth among educational approaches; an educational 
growth model in which achievement was related to innovcitiye emphasis, 
number of minutes of instruction per day, pretest, socioeconomic 
status, and teaching qualifications; a posttest achievement score 
statistically adjusted for pretest and socioeconomic differences; 
groups of students with similar educational experiences who, on the 
average, performed either much better or much worse than was expected 
from their pretest and socioeconomic status; and students who 
demonstrated particularly large achievement gains during two 
consecutive school years. '"Data Collection Instruments and 
Guidelines" developed for Project LONGSTEP referenced in Vol. I, 
Chapter II, Section C, will be accessioned TM C05 987 in RIEMAY77. 
(RC) 
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. APPKNDlX ir-A 

C,u Lde 1 ines for the Select ion of 
Candidate Programs -for Participation Ln Project LCWCiSTIil' 



l - ro £ r . nm .^y_°J\ L? -ipd Intensity 

a. ,.. The program should be Located in formally established pub 1 i • 

or pr i va te e 1 ementary or secondary schoo l.s . 

b, A sizable proportion rf the .students . in the school (i.e., 
greater than 10'/') should be included, making a total of at 
Km:;' 200 students spanning several classes and at least 
three grade^ I eve Ls . 

c, Tile number of students in the program should be 1 -adequate to 
provide a reasonable number of cases per eel I in the antici- 
pated- ana lyt ic schemes. 

d. The innovative or experimental component should be adminis- 
tered in the same grades in several schools. 

Program Content * 

a. The^greater £he variety of treatments within a program the 
better, as long as an adequate number of students are 
involved in each component. 

b. There should be a high degree of behavioral specificity fn 
the description of innovations. It must be possible to 
describe exactly what is done, not merely 'the formulation 
of a policy! 

c. The program should have explicit objectives and expected 
outcomes which have applicability iri a variety of eduea- 
t: i ona ! se 1 1 ings . 

» " • • i 

d. The program should 'nave a strong theoretical basis and/or 
clear rationale indicating in what manner it departs from 
traditional class instruction and the reasons for such 
change. 

ri-A-i 



l j . The program should involve, or have a high probability of 
obtaining, adequate control or comparison groups. 

f. The program should be reasonably free from significant 
. negatives which are unlikely to change; for example, a 

program in an area with very low teacher salaries, inadequate 
.'facilities, or overcrowded classrdoms should.be avoided 
unless the program is intended to overcome these deficiencies, 

t ' ''' 

3- ^S? ™. P. 0 . 1 ^].". 11 .^}' nncl In.tegri.tv 

a. There should be a high probability that the program will 
continue in operation for at least three years as indicated 
by stated objectives and funding prospects, 

b. The program components should have an expectation of 
stability and consistency to permit valid and reliable 
interpretation. of thcVLr effects within the program. 

c- As 'much as possible the program .should" be free from external 
and confounding influences that are not an inherent part of 
the program. If a program cannot meet this condition, then 
r.he^external factprs must lend themselves to explanation 
either in quantitative or qualitative terms so that they 
may be paftialed out of the results. 

d. The program should not be, the subject of in tensive* study 
by other organizations nor should the. students in the 
.program be under intensive study by other organizations. 

4- Pjpgja™ Cooperation^ and Support 

a. The administrators of the program and the faculty" and 

administration of the schools should be willing and able 
to cooperate significantly in the longitudinal study. 
This would be evidenced by a willingness to, participate 
both in the coordination of data ' gathering and in the 
administration of tests and questionnaires. 
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The program arul its nnipfrat i n£ schools should have, or be 
willing to sot up , some svs tern for p rov i d i m; spin- i f i c infer- 
mat ion on riianp/s in program romponen Ls , such as tin- adding 
ot ^rados, the r 1 i r i n>» of now teachers, i ho purchase of 
adiiition.il equ i pmen L , or the introduction oj administrative 

InlervMi ion on which students are roeeivim; which componen t s 

; i*o.»r.:-) should ho in existence or readily available. 
' [) ■ <iou saould also ho madc^ for obtaining information on 
what iher treatments the program students m i t bo receiving 
out si do of the specific program under stud v. 

There should be a positive altitude toward participating in 
tlie longitudinal studv on the part of district, eountv, state 
and other off ioi a Is whose permission would be required*. 

Support for part ieipat in^ in the longitudinal studv should 
eone from the faculty and its teacher assoi: i at ion or union, 
if appropriate. There should be a h u;lt probabilitv of a 
favorable response from both the students and' the community, ' 
or at least an absence of antagonism toward the idea of a 
1 on.n i tuii i na 1 s t udv . 
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APPErwix hi-b 



Items and Item Alternative Weights Used 
in the Computation of Teacher Questionnaire Scales 



in 



Scale 



Itcis and Item Alternative Heights Used 
m the Coipatation of Teacher Questionnaire Scales 



—~ ^ ^Vm__ Alternatives 

HOE Age UcdTk 

24 - Under 26 
* 30 - 26 to 35 
40 - 36 to 45 
50 - 46 to 55 

; 60 - 56 to 65 

J 6tf - 66 or older 

.Teacher Socioeconomic / x-TSB P-..W n 

Background , / ™ Fat ^ s Occupation Ite ^ 

k " P rofessional - such as teacher, 
doctor, engineer, lawyer, sci- 
entist, dentist, social worker, 
public accountant 

'1 - Manager or business ounp r - ' 
such as store or office manager, 
banker, business owner, farm 
! operator or owner, government 
official, military officer, real 
estate or insurance salesman 

'■ 2 ' Skilled craftsman or foreman - 
such as carpenter, mechanic," ' 
plumber, electrician, factory 
foreman, policeman, draftsman, 
technician, enlisted man in 
armed services > 

■ ~ Office worker or sales clerk - 
such as bank clerk, store cTerk, 
bookkeeper, mail clerk, office ' 
worker 

1 - Wnrba_njTMaJwej- - such as 
factory worker, gardener, bus 
driver, gas station attendant, 
farm worker, waiter 

0 - I don't know . 

(Continued) 



Items and Item Alternative Weights Used 
in the Computation of Teacher Questionnaire Scales 
(Continued) 

Scale Abb rev. Scale Items Alternatives 



Father's Education , Item 5 



5 - Graduated from a 4-year college 
h - Some college (1-3 years) 
T - Graduated from high school 
2 - Some high school 
I - Grade school 
0°- \ don't know 



Mother's Education Item 6 



5 - Graduated from a 4-year college 



4 



Some college (1-3 years) 
3 - Graduated from high school 
2 - Some high school 
1 - Grade school 
0 - I don't know 



Type of Undergraduate* T-TUl Type of institution Item 

Institution 



9 . 



Public - university, college, 
or technological institution 

Private - university, college, 
or technological institution 



1 - Public - normal school* teachers 
college, junior college. » or 
similar public* institution „ 

1 - Private - normal school, teachers 
college, junior college, or 
similar private institution 

(Continued) 

er?c - 23 
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Items and Item Alternative Weights Used 
in the Computation of Teacher Questionnaire Scales 
(Continued) 



Scale 



Abbiev. 



Scale Items 



Alternatives 



Highest Degree Offered 



Itra 10' 



5 - Doctor's deg:\- 
■i - Master's dog : ■ 



1 -; Professional »: ihvialist 



I - Elementary Education 

I - English or Journalism 

0 - Mathematics 

0 - I did not no to college 
(Skip to Question 13,) 

0 - Business-Commercial 

0 - Foreign Language' 

U - Home Economics 

0 - Industrial Arts 

U - Music-Art 

0 - Physical Education-Health 

0 - Biological or Physical Science 

0 - Social Science, including History 

0» Other , 



diploma {sixth war) 
2 - Bachelor's degree 
1 r Certificate only 




Undergraduate Major 



Item 1 



(Continued) ' 



2! 
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Items and Item Alternativu Weights I'sed 
in the Conputai i.-n of Teacher questionnaire Scales 
(Continued) 



Scale 



Abb rev, 



Undergraduate Major- 
Mathematics 



caching Ouali! i m Lions s T-TQ 



Scale Items 



T-UMM /Undergraduate Major 



Highest Degree 



Years Teaching 
Experience 



Alternatives 



Item 1 

i - Elementary 

(I - English or Journalism 

1 - Mathematics 

0 - I did not go to college 

. (Skip to Question 13.) 

0 - Business-Commercial 

0 - Foreign Language 

0 - Home Economics 

0 - Industrial Arts 

0 - Music-Art 

0 - Physical Education-Health 
0 - Biological or Physical Science 
0 - Social Science, including History 

0 - Other ,> ' 

Itc::i 15 

k - A master's degree or higher 
3 - A bachelor's degree 

1 - A degree or diploma based or 

less than 4 years of work 
1 - No degree 



Item 19 



9 - 30 or more 
8 - 20-29 
7 - 10-19 
b - 5-9 
5 - k / 

3 - 2 
2'- 1 
1 - None 



(Continued) 



Items and Item Alternative Weights Used 
the Computation of Teacher Questionnaire Scales 
(Continued) 

Abb rev, _Sc;i 1 u Items 

Years in Present 

School 



Certification 



Alternatives 



Iteni 1\ 
year or more 

2()lh to 29 rh vear 

h to ] ( jtli Year 



> - )tli to 9tii vear 

4 - 'ttli year 

1 - Ird yeyr 

2 - 2nd year 
I. - 1st vear 



Item 21 

The highest certification offered 
in this state (such as life, per- 
manent, or long-term) 

Regular certification but less than 
the highest certification in this 
state 

Temporary, provisional, or emer- 
nencv certification 



Concert if ied 



(Coin inued) 



Items and Item Alternative Weights Used 
in the Computation of Wher 'Questionnaire Scales 
(Continued) 



Scale 



Abbrev. 



Scale Items' 



Alternatives 



wnent Status 



H 
H 



Teacher Associations or 
Union Participation 



T-TAUP 



Professional Associ- 
ations Participation 



Item 2fi 

) - I have achieved tenure on a continu- 
ing contract basis. 

k - I have a regular full-time appoint- 
ment, but I do not have tenure. 

3 - I am a substitute' teacher 

2 - I air. an intern teacher or in the 
Teacher Corps. 

1 - Other (such as teacher aide, hourly 
consultant, etc.) 

Item 33 

3 - Yes, I am an active worker 
2 - Yes, I am a, member but not an 

active worker 
1 - No 



Current Professional 
Reading 
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ERIC 



T-CPR 



Reads Journals 



Item 34 

4 " Yes, 3 or more regularly 
3 - Yes, 2 regularly 
2 ~ Yes, 1 regularly 
1 - No, not regularly 

(Continued) 
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Scale 



Items and Item Alternative Weights Used, 
in the Computation of Teacher Questionnaire Scales 
(Continued) 

Abbrev, Scale Items 



Alternatives 



School Reputation 



T-SR 



School Preference 



School Reputation 



H 
H 
H 
I 

CO 
I 



Opinion of School 



Item 27 

r 

5 - Definitely not 
h - Probably not 
3 - I am undecided 

2 - Probably yes 

1 - Definitely yes 

Item 28 

5 - Among the very best 
l\ - Better than average 

3 - About average 

2 -' Below average 
1 - A poor school 
0 - I don't know 



Item 29 

Among the very best 
Better than average 
About average 
2 - Below average 
1 - A poor school 
0 - I am undecided 



5 - 
4 - 
3 - 



(Continued) 



32 



33 



Items and Item Alternative Weights Used 
in the Computation of Teacher Questionnaire Scales 
(Continued) 

. Scale Abbrev . Scale Items ■ 



Administrative Support T-AS Sufficient School ' 

Leadership 



Alternatives 



c ^ ass Size T-CS Average Class Size item 36 



1 - 35 or more 
6 - 30 to 34 

5 - 25 to 29 
4 - 20 to 24 
3 - 15 to 19 

2 - 10 ro 14 

1 - Fewer than 10 



Item 32G 



2 - Disagree 
1 - Agree 



Class Interruptions- item 32L 

j 2 - Disagree 

1 - Agree 

Non-Teaching Tasks « item 320 

2 - Disagree 
1 - Agree 



4' 



\ 



c 
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APPENDIX i II-C 

Means and Standard Deviations 
of Student Questionnaire Scale Items 
(by Year and by Form) 



3.1) 



Means and Standard Deviations 
of Student Questionnaire Scale Items 
(by Year and by Form) 



\ 



Scale (Abb iv; 



Scale Items 



Year 



Form A Form J £ornv C FormJ) Form £ 

.M Si) M™" SD"~ M "s» ">i SD M SB 



Socioeconomic Status (S-SES) Head of Household's 1970-71 2.52 1.03 2,35 1,07 

Occupat ion 

' l| 1 ^ 71-72 2.40 1.01 2.35 1.05 

1972-73 2.45 1.04 2.43. 1.04 

Father's Education 1970-71 2,50 0.58 2.28 0.65 

,971-72, 2.45 0.55 2. 37 0.61 

1972-73 2.52 0.55 2.41 0.59 

, Mother's Education 



■71 2.37 0.58 2.18 0.59 

1971- 72 .2.33 0.53 2.26 0.58 

1972- 73 2.40 0.56 2.30 0.55 



2.33 1.02 2.39 0.99 

2.39 1.01 2.40 1.00 
2.48 1.01 2.42 0.99 

2.44 0.59 2.35 0.59 

2.46 0.59 2.39 0.59 

2.52 0.58 2.38 0.59 

2.35 0.56 2.32 0.52 

2.40 0.54 2.33 0.54 
2.46 0.54 2.32 0.54 



Welfare Assistance (S-lvA) 



Welfare Assistance 1970-71 1.93 0.24 .1.92 0.27 

1971- 72 1.92 0.27 1.93 0 .26 

1972- 73 1.91 0.28' 1,93 0.26 



icy (S-RMA) 



9 
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Daily Newspaper 



Magazines in Home 



19/0-71 - ■ - 


- 3.75 


1.16 


3.76 


1.11 


3.77 


1.11 


1971-72 - 


- , ' -, 3.91 


1.13 


3.88 


1.10 


3.84 


1.07 


1972-73 - 


- 3.93 


1.12 


3.95 


1.06 


3.84 


1.08 


1970-71 - 


- 1.81 


0.39 


1.86 


0.35 


1.91 


0.28 


1971-72 - 


- 1.83 


0.38 


1.86 


0.34 


1.90 


0.30 


1972-73 - 


- 1.81 


0.39 


1.87 


0.34 


1.89 


0.31 


1970-71 - 


- 3.52 


1.37 


3.22 " 


1.24 


3.04 


1.16 


1971-72 - 


- 3.61 


1.34 


3.28 


1.25 


3.15 


1.13 


1972-73 - 


- 3.52 


1.34 


3.27 


1.22 


3.06 


1.13 








(continued) 




38 



< 



Means and Standard Deviations 
of Student Questionnaire Scale Items 
(by Year and by Form) continued 



.ta Collection Form 







School 


Form A Form B 


Form C 


Form D 


Form E 


Scale (Abbrcv.) 


Scale Items 


Year 


_ 


" so m" * s! 




SD 


M 


SD 


M 


SD 


F.r,ily Structure/Stability 

i C IT ' C \ 


Child Resides With 


1970-71 


3.85 


0.39 - 


3,82 


0.43 


3.80 


0.46 


3.79 


0.49 






1971-72 


J . OM 




J.flj 


n in 


J.olJ 


U.45 


J. 76 


A C 1 

0.51 


< 




1972-73 


1 in 
) . ■ i i 




J.oO 


A '17 
U. J/ 


J.oU 


0.45 


3. 75 


A C T 

0.53 


• 

irental Kducat iona L Expec- 


How tar in School 


1 AT A 11 

1970-71 


- 


- 


3.46 


0,86 


3.46 


0,81 


3.29 


0.85 


tations (S-PFE) 




1971-72 
























3,49 


0.82 


3,39 


0.85 


3.21 


0.87 






1972-73 






3.48 


0.83 


3.42 


"0.84 


3.18 


0.88 




Parents 1 Desire 


1970-71 






3,60 


0.66 


3.32 


0.72 


3.21 


0.75 




lor Excvllence 


1971-72 


























J • J 7 


U.OJ 


J. il 


A "J A 

0./2 


3.25 


A It 

0.74 






1972-73 






3.57 


0.67 


3.32 


0./1 


3.23 


0.76 


Attitude toward School 


Likes School 


1970-71 


- 


- 


3.15 


0.96 


3.03 


0.80 


2.98 


0.77 


(S-ATS) 




1971-72 


- 


- 


3.08 


0.93 


'.97 


0.82 


2.93 


0.77 






1972-73 






3.10 


0.93 


2.96 


,0.80 


2.95 


0.76 




Importance of 


1970-71 




•m mm M 


2.79 


0,46 


2.62 


0.55 


2.29 


0.61 




Good tirades 


1971-72 
























2.80 


0,45 


2.57 


0.57 


2.28 


0.62 






1972-73 






2.78 


0.47 


2.57 


0.57 


2.30 


0.62 


At : i tnde toward Language 


Interest in 


1970-71 






2.84 


1.09 


2,58 


0.96 


2.44 


0.94 


Arts (S-ATI.A) 


English 


1971-72 


























2.74 


1.07 


2.51 


0.97 


2.50 


0.95 






1972-73 






2.69 


1.07 


2.55 


0.95 


2.54 


0.94 



ERIC 



n a 



(continued) 
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Means and Standard Deviations 
of Student Questionnaire Scale Items 
(by Year and by Form) continued 



Scale (Abb rev., 



Reading Interest (S-RI) 



Sca le I terns _ 

'.lumber, of Books 
Read ' 



Enjoy Reading 



Attitude toward Hath (S-ATM) Interest in Hath 



Importance of School (S-IOS) Importance of 

Finishing School 



Feelings about 
Stopping School 



Homework (S-Il) 



9 

ERIC 



Time Spent on 
Homework 



School Form A 



Form 



Data Col lee t ionjorm 
3 Form C 



Form D 



Form E 



Year M 


SO )\ SD 


N 


SD 


H 


SD 


M 


SD 


1970-71, - 


- 


4.13 


1.43 


3.49 


1.43 


3.16 


1.42 


1971-72 - 


- 


4.13 


1.43 


3.43 


1.46 


2.90 


1.39. 


1972-7 ] - 


- 


A.04 


1.41 


3.51 


1.45 


2.93 


1.37 


1970-71 - 


- 


2.66 


1.43 


2.48 


1.24 


1 39 


1.14 


1971-72 - 


- 


2.67 


1.42 


2.48 


1.24 




1.12 


DILI J 




2.65 


1.37 


2.53 


1.23 


2.34 


1.11 


1970-71 - 




') si 


11. 0 J 


Lii 


ft L ( 

0,66 


2.27 


0.68 


1971-72 - 




1 AQ 
L . 47 


U , 0 ? 




ft L 1 

0.67 


2.24 


0.69 


1972-73 - 


- 


2,48 


0.63 


2.30 


0.55 


2.25 


0.68 


1970-71 - 




0 01 


1 1 1 




1 no ' 

1 .02 


2.27 


1 A 1 

l.Ol 


1971- 72 - 




L i OU 


1 111 




i ni 
1.01 


2.28 


1 f\ n 

l.Ol 


1972-7 3 - 




2 .79 


1.10 


2.53 


0 99 




1 lifl 


1970-7, - 


- 


- 


_ 


2.76 


0.50 


2.72 


0.53 


1971-72 - 




- 


- 


2.71 


0.53 


2.71 


0.53 


1972-73 - 


~ — 


- 


- 


2.7? 


0.51 


2.72 


0.52 


1970-71 - 


- 


- 


- 


4.06 


1.02 


4.04 


0.99 


1971-72 - 


- 




- 


3,88 


1.10 


4.01 


1.03 


1972-73 - 








3.85 


1.08 


4.04 


0.98 


1970-71 - 




2.18 


0.89 


2.48 


1.02 


2.48 


1.03 


1971-72 - 




2.25 


0.85 


2.30 


0.97 


2.46 


1.02 


1972-73 - 




2.16 


0.88 


2.41 


0.96 


2.54 


1.03 
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Means and Standard Deviations 
of Student Questionnaire Scale Items 
(by Year and by Form) continued 



Scale (AbhrEv.) 



Scale Items 



School 
Year 



Form A 



Data Collection Form 
Form B Form C Form D 



SD 



SD 



Form E 



SD M SD M 



SD 



Social Facility (S-SF) 



Makes Friends 
Easily 



1970- 71 1.79 0.40 1.73 '0.44 

1971- 72 1.77 0.42 1.73 0.44 

1972- 73 1.78 0.41 1.74 0.44 



Social 

Aggressiveness 



Confidence with 
Adults 



1970- 71 1,58 0.49 1.56 0.50 

1971- 72 1.56 0.50 1.58 0.49 

1972- 73 1.58 0.49 1.57 0.49 

1970- 71 2.05 0.65 2.02 0.64 

1971- 72 2.07 0.65 2.01 0.63 

1972- 73 2.06 0.65 2.02 0.62 



Social. Identity (S-Sl) Liked by 

Classmates 



ERIC 



Makes Friends 



Friends Listen 



Satisfaction 
With Self 



1970- 71 

1971- 72 

1972- 73 

1 970- 71 

1971- 72 

1972- 73 

1970-71 
, 1971-72 
1972-73 

1970- 71 

1971- 72 

1972- 73 



2.47 


0.66 


2.64 


0. 


55 


2.68 


0.50 


V)() 


0.65 


2.63 


0. 


56 


2.69 


0.51 


2.52 


0.65 


2.65 


0. 


55 


2.69 


0.50 


2,31 


0.64 


2.44 


0. 


58 


2.45 


0.59 


2.32 


0.63 


2.44 


0. 


57 


2.46 


0.58 


2.35 


0.62 


2.45 


0. 


58 


2.50 


0.57 


2.27 


0.62 


2.46 


0. 


56 


2.57 


0.53 


2.31 


0.61 


2.46 


0. 


56 


2.57 


0.52 


2.35 


0.59 


2.48 


0. 


55 


2.58 


0.52 


2.13 


0.80 


2,23 


0,80 


2.34 


0.78 


2.17 


0.80 


2.29 


0. 


79 


2.43 


0.7b 


2,27 


0.79 


2,40 


0. 


76 


2.51 


0.73 



APPENDIX I n-D 



Number of Students Completing 
Student Questionnaire Scale Items 
(by Year and by ForPi) 



Number of Students'Completing 
Student Questionnaire Scale Items 
(by Yeajjnd by Form) 



Scale (Abbrcv.) 


Scale IIl'ijs 


School 
Year 


Form A 


rorm i) 


Form C 


i'orm D 


Form E 


Socioprnnnmi c ^Mhic ^ Q_cttc \ 


neaci ot House- 


1 Pi 1(\ 1 1 

1970-71 


1651 


6129 




5767 


; 2455 




hold's Occupation 


1071 "JO 

19/1-/2 


1744 












5335 




51.41 ■ 


3989 ■ 






1972-71 


111 

ill i 




■■ 


o/lo ' 


5999 


• 


r acner s taucation 


19/0-/1 


1333 - 


, 5377 




4193 


2147 






1071 V) 

■ 1V/1-/Z 


i c n 

1573 


•• 4901 




3912 


3744 






1 Q 79—71 


u / 0 


JODl 




5363 


5738 


• 

• 


Mother s Education 


1970-71 


1336 


■ 5544 




4550 


231ft 






1 ft ~l 1 "7 n 

1971-72 


1662 


5244 




4237 


3986 , 


< 




1972-73 


719 


3819 




JO'IO 


OUOJ 


WpI f^TP A^QKfanrp f^-UA^ 


weirare Assistance 


iy/(j-/i 


i L on. 

162 Q 


; 6108 






- 






1971-72 


1889 


5455 












1972-73,. 


876 


4015 


_ 




1 


Rpprlinfl Material 


Number of Books 


19/0-/1 






6964 


6443 


2668 


Availability (S-RMA) 


in Home 


1Q71 70 
Li /1-/Z 








/ 






5159 


5783 


4494 






1972-73 






Jtu / 




L 101 

6787 




uany Newspaper 


19/0-/1 






6963 


6424 


2642 






LJll-ll 






5146 


, 5774 


4426 






1972-73 






3618 


7513 


6635 




Magazines in Home 


1970-71 






6960 


6426 


2639. 






1971.-72 






5147 


5773 


4491 






1972-73 






3623 


7516 


6717 



(continued) 



Number of Students Completing 
Student Questionnaire Scale Items 

(by Year and byjorl) continued 



Scale (Abb rev.i 



Family Structure/ 
Stability • (S-FS/S) 



Parental Educational 
Expectations (S-FEE) 



Attitude Toward 
School (S-ATS) 



Attitude Toward 
Language Arts (S-ATLA) 



5 

EMC 



Scale Items 



School 

.Year Form A Form R 



Child Resides with 1970-71 
■ 4971-72 
, 1972-73 

How Far in School 1970-71 
1971-72 



Parents' Desire 
for Excellence 



Likes School 



Importance of 
Good Grades 



Ir-.erest in 
E^iish 



1972-73 
, ■» 

1970- 71 

1971- 72 

1972- 73 

1970- 71 

1971- 72 

1972- 73 

1970- 71 

1971- 72 

1972- 73 

1970- 71 

1971- 72 

1972- 73 



1982 



941 ' 



Form C 


' Form D 


Fnrni F 

1 U L ill L 




( ! C C ' 


2667 


Jill 


j/4<: 


4493 


3628 


7A59 




5956 


6431 


2191 


C 1 / / 


5767 


3757 


3624 


• 7486 




07Di 


6420 


2637 




5770 


4485 


3620 


7506 


U / L\) 


D7D0 


b44o 


2664 


jjjj 


C 7 O O 

5/oJ 


4500 


3628 


7544 


6808 


6967^ 


6439 


2655 


5149 


5770 


4495 


•3619 


7521 


6783 


6965 


6428 


2643 


- 5152 


5777 


4491 


3621 


7528 


6741 



(continued) 
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Number of Students Complcrinji 
Student Questionnaire Scale [t< j ms 

(bv fear and by Form) vowt Lnued 

School 



Scale (Abbrev.) 


Scale jtenis _ ^ ■ 


Year Form A 


Form 11 


Form C 


Form 1) 


Form 


RpifliniT Inform!" K-RiM 


Niimbp'r (if Books 


1970-71 ' - 




6971 


%]% 


2643 




Read 


1971-72 


_ 


51(32 


5784 


4501 


• 




1972-73 , - t 1 


- 


3631 


7526 


6822 




Numb pr of Libra rv 

lit HULL \' • ULUIUI 1 


1970-71 




6967 ■ 


6450 


2670 




Visits 


' 1971-72 


_ 


5157 


57 77 


4504 






1972-71 ' - . 


- 


3626 


7530 


6798 




Fninv RtMilitvj 

Ll| L\i li U L L 1 L- 


1970-71 




6965 


6446 


2665 






1971-72 


_ 


5035 


5 776 


4504 


! , 




1972-7 J 


- 


36 If! 


7525 


6797 


w 

all it Hue iowaiu 


lIlLULL.hL ill ♦IdLll 


1970-71 




6962 


6428 


2643 


Math (S-ATM) 




1971-72 




5145 


5763 


4494 






19 72-7 3 


- 


1618 


7520 


6742 


impor Lcincc oi 


Imnnrr inn* nf 


1970-71 ' 






6414 


2645 


School (S-It)S) 

1 


Finishing School 


1971-72 




„ 


5772 


4491 






1972-73 


- 


» 


7506 


6741 




Fpp 1 inns About 


1970-71 






6399 


2634 




Stopping School 
• 


1Q71-7' 1 






5773 


4483 






19 72-7' 


■ 


— 


7514 


6703 


Homework (S-ll) 


lime Spent on 


1970-71 




h753 


6134 


2428 




Homework 


1971-72 




5010 


5524 


4082 






1972- 73 




3528 


7248 


6302 


50 










(continued) 
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Number o, Students Completing 
SLMce'it 1 - Qu k» ionnaire Scale Items 

'(by Year and bv Form) continued 



School 

;aic (Abb^r^v. ) _S CciJe_Ueras_ _ Js*L. l.J.°J± A... __Porm _B Form C Jorm I) Form E 

/ility (S-SF) Makes Friends 1970-71 19 19 M7'J 
Easily 

J 1971-72 2008 . 5839 

1972-73 927 4198 

Social Aggressive- 1970-71 1961 f)92<i - 
ness 

1971-72 2060 6000 

■ 1972-73 942 1 4 358 

Confidence with 1970-71 1912 6888 

Adults 

, 1971-72 2038 5959 ' - 

, 1972-73 940 4324 ' - 

jntity (S-SI) Liked by 1970-71 - - 6971 ' 6443 2662 
Classmates ^ n 

1 971-72- - 5151 5766 4481 

• ■ 1972-73 - - _ 3626 7512 6787 



ERIC 



Makes' Friends ' 1970-71 - - 6968 6442 

Easily 



2661 

1971-72 - - 5158 5758 4494 



1972-73 - - 3628 7510 6783 

Friends Listen 1970-71 - - 6966 6441 2661 

1971-72 . - - 5153 57t: 4490 

19.72-73 - - 3624 7502 67 74 

(continued) 



Si 



Number of Students Completing 
Student Questionnaire Sealo ItiTN 

(by War ;ind by Form) roni imu.'d 



School 

^Ak l l.-^] , ! 1 _ r . < ?_Y.-.] _ A ( AL 0 ..J>:J 11S . _YviL r . _F'um A Perm \\ Form C Fonn_ D Form F 

entity (S-SI) Satisfaction with 1970-7] - - 6429 2Mb 

ht ' lf 1971-72 - - 5147 5761 4479 

1972-73 - - 1620 7474 6742 



TOTAL NUMBK 1 F STUDENTS 19 70-71 2004 '■' 1 7147 6482 '679 

19 71.-72 2075 <;L15 ' 61L5 5804 50 

19 72-7 3 946 ..4497 4497 7568 ■ u843 



55 



ERLC 



APPENDIX TTI-E 

.Means, Standard Deviations and n's 
of Teacher Questionnaire Scale Items 
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Means, Standard Deviations and n's 
of Teacher Questionnaire Scale Items 
(By Year) 



Scale (Abbrev.) 


Scale 1 terns 


School 
Year 


Means 


Standa rd 
Deviat ion 


n's 


t\£(* { 1 -AGE ) 


Age 


19 70-71 


36. 


,98 


11.46 


858 






1971-72 


36. 


13 


10.84 


778 






1972-73 


36. 


82 


10. 48 


881 


Teacher Socioeconomic 
Backg round (T-TSB) 


Father's Oecu- 

D 'A t i n n 


19 70-71 
1971-72 


2 , 
2 . 


.48 
.49 


0.98 
1,01 


851 
764 






1972-73 


2. 


.51 


0.99 


859 




Fa the r f s Kduca- 


L970-71 


2. 


. 72 


1 . 40 


OZo • 




L ion 


19 71-72 


2 . 


.84 


1 .48 


745 






1972-73 


2 


,84 


1.47 


841 




Mother T s Fduca- 


1970-71 


2. 


89 


I. 31 


837 




t lo n 


19 71-72 


2 . 


96 


1.29 


755 






1972-73 


2 . 


89 


1.48 


859 


Ty;)e of Undergraduate 


Type o f I ns t i- 


19 70-71 


1. 


.81 


0.40 


844 


[institution (T-TUI) 


t lit ? on 


1971-72 


1. 


.83 


0. 38 


771 






19 72-73 


' 1 . 


.85 


0. 35 


870 




Highest Degree 


1970-71 


j . 


. o 1 


1.14 


844 




Offered 


1971-72 


3. 


.89 


1.15 


772 




■» 


1972-73 


3. 


.89 


1.17 


873 


Undergraduate Major- 


Undergraduate 


1970-71 


0. 


.53 


0.50 


836 


English (T-UME) 


Maj or 


1971-72 


0 . 


.52 


0.50 


768 






1972-73 


0. 


.44 


0. 50 


. 858 


Undo rg ra d ua t e Ma j o r- 


Undergradua te 


1970-71 


0 


.45 


0.50 


836 


: In th enia Lies ( 7 - UMM ) 

i 


Ma j or 


1971-72 


0 


.46 


0.50 


768 






1972-73 


0 


. 39 


0.49 


858 


1 ' 


«i I [-!•>; 


1 






( con t inued) 
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'(By Year) 
Scale (Abb rev. ) 



Means, Standard Deviations and n\s 
^of Teacher Questionnaire Scale Items 
' fUs ' v (continued) 



Teaching Qualifica- 
tions (T-TQ) 



\ 



V 

V 


School 






S tanda rd 




Scale Items 


\ Year 


Means 


Deviation 


n 


Highest Degree 


19 70-71 


3 


.17 


0 


.60 


o j Z 




1971-72 


3 


.24 


0 


. V} 


781 




1972-73 


J 


. Z 1 


0 


. 54 


1 883 


Ye a r s o t" Te ach- 


.1970-71 


5 


.40 


2 


. 22 


849 


ing Experience 


1971-72 














5 


.58 


2 


.03 


780 






5. 


.63 


2 


.00 


883 


Years in Present 


1970-71 


3. 


.20 


1. 


,83 


848 


Schoo 1 


iy / i— / z 














3. 


.48 


1. 


,81 


779 




1972-73 


3. 


.68. 


1. 


80 


883 


Cert if icat ion 


1970-71 


3. 


,26 


0. 


81 


840 




1971-72 


3. 


28 


0. 


73 


777 




1972-73' 


3. 


34 


0. 


72 


876 


Employment 


1970-71 


4. 


35 


{). 


86 


850 


St M us 


1971-72 












4. 


48 


0 . 


74 


781 




1972-73 


4. 


49 




78 


.'-76 



Current Prof ess ional 
Reading (T-CPR) 



Reads Journals 1970-71 

1971- 72 

1972- 73 



2.12 1.01 854 

2.18 0.98 781 

2.16 1,04 882 



Teacher Associations Professional 1970-71 2.07 0.63 852 

or Union Participation Associations 

(T-TAUP) \ Participation 1971-72 2.07 0.59 781 

1972-73 2.05 0.60 884 
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(continued) 
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Means, Standard Deviations and n's 
of Teacher Questionnaire Scale Items 
03y Year) (continued) 







Schoo j 






S t and a rd 




Scale (Abb rev. ) 


Scale F terns 


Year 


Means 


Devi at ion 


n's 


Reputati on (T-SR) 


Schoo I 


1970-71 




DO 


0.95 


851 




Preference 


1971-72 


4, 


.OA 


1.05 


779 






19 72-71 


'» . 


.08 


l no 


no I 




Schoo 1 


1970-71 


3. 


,74 


1.16 


762 




Repu tat ion 

a 


19 71-72 


3. 


SO 


1.15 


701 






1972-73 


3. 


, 81 


1.13 


797 




Op in i «n o f 


19 70-71 


3. 


98 


0.96 


791 




Schoo] 


1971-72 


4. 


, 1 2 


0 . 89 


760 






1972-73 


4 . 


,09 


0. 89 


871 



Class Size (T-CS; 



Average 
(Mass Si;:o 



1970-71 
197 1-72 
1972-73 



5.08 
5.18 
5.21 



1 . 4 7 
1.31 
1.17 



828 
775 
874 



Admin is t ra t i ve 
Support . (T-AS) 



Su f f i c i ent 
School 
LtN'idc rsli i p 



Class 

Interrupt i on? 



No n -To a ch i ni T 
Tasks 



1^70-71 
197 1-72 
1972-73 

1970- 71 
19/1-72 
1072-73 

I 970-71 

1971- 72 

197 2- 73 



1 . 75 
1 . 70 
1 .'73 

1.7/4 
1 .65 
I .62 

I , 56 
1 .47 
1 . 50 



0 . 4 3 

n. 46 

0.44 

0.44 
0.48 
0.48 

0. 50 
0. 50 
0. 50 



821 
767 
869 

827 
774 
877 

830 
7 78 
877 



Total Number 01 

To a c h o rs per Year.. 



1 4 > 7 0 - ; 



19 72-7 J 



858 
78 3 
88 5 



1.508 different teachers completed qu» -st i onna i res during one or more vears 
o f t he s t udv . 

[ I I -! - { 
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APPENDT X III-F 

Verification of the 
Project LONCSTEP- Questionnair. 
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VERIFICATION OF THE PROJECT LOVSSTKP QUEST tONNA 1 RE DATA 1 

During the second year of Proj :t LONGSTEP, we undertook two audi 
to gauge the dependab L 1 ity of data Fron; our questionnaires. One ,„u- 
cerned student ana i oacher reports (in Questionnaires C, I) or E, ,hy stu 
dents; or, in A or B, by teachers) of .students' home backgrounds; the 
other, teacher. assessment of the student. They involved subtle differ- 
ences in rationales. For the -first, respective parents' answers cou'd 
serve as checks on students or on teachers, thus in each case with two 
independent sources of inaccuracy (student and parent, or- teacher and 
parent). For the second, teachers were to repent sel ect ed items about 
two months after the first administration; here discrepancies res.,11 
either from teacher unreliability or from real student change. , 

Two sampling procedures were involved: a random sample of two 
percent of all students in the study in 1971-72, and a selected sample 
of items drawn from a wide range of scales used. We aimed at using a 
small number of items common to all levels of questionnaires.' For the 
Parent verification, items were selected so that each could reasonably 
be answered by both student and parent. There were two parent verifica- 
tion questionnaire forms which were parallel to the different types of 
student forms. The student Form A, which requested background informa- 
tion about first and second grade pupils, was originally .filled out by 
their, teachers because of the children's limited reading abiiltv. Veri- 
fication Form A, sent to parents of first and second grade students, con 
tained seven questions. Verification Form R-E , sent to parents o. 
third through ninth grade students, who had filled out th-ir own stu- 
dent quest ionnairo forms.. |ncluded the same, questions as verification 
Form A, with five additional questions. 

, For rne verification of teacher reports on stuaents, seven items 
related to teacher 'evaluation of students were selected from the teacher- 
completed student qucsr ionnaire. These items were different from other 



Adapted trom Roberts, A.n.H. f, Roberts, S. .1. Ve, it icat ion c -i„. 
Lf.v.e.'ii'Ai nA'._ s V ^^^J^PPir^P: 1 t ;^ Memorandum" repo'ri " PaYo~A~l r o 
(.alitornia: American Institutes for Research, Januarv 1973. 
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items of this instrument which wero related to background-type infor- 
mation about the student and which were included in the parent verifi- 
ca t ion ins tr ument . 

Using random number tables, a 2% student sample was selected from 
each grade level in each school participating in Project LONGSTKP . 
Three hundred forty-two students were selected. Names, addresses and 
telephone numbers of parents or guardians were obtained from school 
principals during site visits conducted in spring, 19.72. Teachers of 
students in grades 1 through 5 were obtained from school' and project 
data files . 

The parent verification questionnaires, including an explanatory 
letter and directions on the first page, were mailed with a stamped, 
addressed envelope for returning the completed forms. Reminder ler- 
* ters were also prepared, to be sent to non-respondents. All letters 
were designed to be brief but persuasive, to acquaint the parents with 
the purpose of the study and encourage them to reply. As an incentive 
for the return of completed questionnaires, a new Eisenhower dollar in 
a plastic display container was to be mailed to each respondent. 
Copies of the questionnaires and reminder letters are included in 
Attachments 1 through 6. 

f 

The procedures used for mailing questionnaires and recording 
responses were designed from pbs^experience with mail surveys, which 

had shown that a period of two weeks was sufficient for responses to 

I ' J 

reach a peak, decline, and virtually , Cease . At this point, some sort 
of reminder needed to be sent. Ac^o^dinglv, the mailings to parents 
were planned for cycles of about two weeks, and were carried out as 
fol lows : 

• All parents in the sample were sent the questionnaire, 
which included the explanatory letter and directions 
on its first page, accompanied by a prepaid return 
envelope and a slip for specifying the address to which 
the dollar was to be sent. 

• Two weeks after the questionnaire had been sent, a first 
reminder letter was sent to all noiv-respondents , along 
with a second copy of the questionnaire. 

I 1 r-r-2 
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* Two weeks aftt r the first reminder, a second reminder was 
mailed to al " temaining non- respqnden ts . All reminders 
included an additi onal copy of the questionnaire and a 
prepaid return envelope. 

• Two weeks after Lne second reminder, non- respondents were 
contacted by telephone. Phone calls were made at differ- 
ent times through c the day, and continued over several 
days until every parent with a telephone had been con- 
tacted ind had either answered or refused to answer the 
questionnaire. Non-respondents who did not have telephones 
were outside the scope of this fourth appeal.. 

There were two mailings of parent verification questionnaires, about 
six weeks apart. This was done because the student questionnaires were 
administered at different times in different schools, from March 10 up 
through May 19, 1972. Mailing jtl included seven sites sent question- 
naires on April 12 and one site mailed on April 17, a total of 143 ques- 
tionnaires. Mailing 02, to the four remaining sites, took place on 
May 25, and involved 200 questionnaires. 

The mailing procedures which have already been described were 
followed for both mai Lings, with one exception in Mailing /*2. This 
mailing had a much poorer rate, of returns in response to the original 
questionnaire and the first reminder, and it was decided that a third 
reminder letter should be sent in the hope of obtaining more, replies 
before beginn . the phone calls. Thus Mailing n had five response 
waves; Mailing #1 had four. 

In both mailings, pnone calls were begun when the number of non- 
respondents remaining had reduced to approximately 1.4 percent of the 
total number of questionnaires originally sent. All remaining non- 
respondents to the mailed questionnaires were contacted by telephone, 
except for those six who had no phone, and two who could never be 
reached. Attempts were made every day to contact each parent on the 
list of non- respondents , arid parents were checked off the list as 
they answered. Whenever someone other than the parent answered, 
callers tried to get information on where and when the parent could 
be reached. Where no one answered the phone at al l., at least one 
other attempt was made later in the day. The two parents wh?o could 



\ 
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never be reached, after daily morning and evening attempts had gone 
on for two weeks, were finally counted as non- respondents . In addi- 
tion -to following a pattern of daily repeated attempts, the telephone 
callers followed the specific guidelines established for use by staff 
members during ' telephone interviews. Table I1I-F-1 presents the response 
rates and total return for the parent verification questionnaires. 
Of the 134 teacher verification questionnaires mailed, 133 were returned. 

It is tempting at first sight to regard the parent verification \ 
and teacher verification as reliability studies and to use some sych 
device as the Spearman Brown prediction formula to devise estimates 
of scale reliability coefficients. For the teacher verification ques- " 
tionnaire this is possible, with the reservation that real change in 
students will be interpreted as error variance. For the parent veri- 
fication, since we have "unco rre la ted" groups (parents and students, 
or parents and teachers), we would, 'strictly speaking, need to square 
the correlation between the two to convert it to a reliability coeffi- 
cient. Rather than try to produce reliability coefficients, however, 
we will report correlations for items separately, with interpretations 
-supplemental to, rather than substitutes for, such coefficients. This 
will leave us free to use contingency coefficients for nominal measures 
(e.g., ethnic group); in addition, we can use this coefficient and a 
coefficient of agreement for all items in addition to the correlation 
coefficient for the sake of the new light they throw on the relation- 
ships. The three coefficients and their interpretations are discussed 
b e 1 ow . . 

The Contingency Coe f f i ci gnt«C 

On the one hand, C is appropriate onlv as a measure of association; 
its value will increase whenever there is bins or any systematic dis- 
agreement between students and parents; and it is therefore not a mea- 
sure of agreement—although high agreement will also cause high C \s . 
On the other hand, the only options one has for nominal measures are 
C and the coefficient of agreement', K, which has its own limitations 
> 1S wil l he seen, in the next section. 



i r- 



!--) 



6 [ 



TAB IF lll-F-1 



Response Rates for P,:;^t Wriflcatlwi 'Jurttloanai 



res 



:V:::»;vi'.mhi,i 



,ia 



Implies ta Hiplii's to 
i;U'jst:o:::iaire 1st Kor :niU*r 



w:>!l.S In :■:■■;)! i- 
2r.«!-:.T.i::..,T "jrJ H- 



T,.:r.: 



•1 



33 l' 1 ('"•) 5 (1)) i (];•) 
- ' 13 ■ (:;!.) 0 ( 0) i! ( ,j) 
11 (5-,) 10 (23) 



j'J 



31 1 19 (til) 



i 1 1 



L_._ 



5 (lo) I U) 
(67) 1 (13) 1 (8j 

(•..:) 2m (l?) 3 ( ■>) 



ei 'i.i i 'i. j 



;i7) 



12 ils) 



•I 1-3? {5',) 40 ft)) 



\ .M J 



1J 



1 i'V'l ! [■>.; J >, 




!.T iOv; '.il! 


Total Ret 












1 


i (L } ) 
(ii) 


.11 ('.) 
!:» ( l t 


3 ( o) 


'.)? (5 


- . . i (11) 


30 p. 




23 (•:; 



Son-Rcspundeats 



'hcr.ud, 



(10) ' JD 



1 ( /f| JS '>M) 



>) 2 



3 ( 3) f> ( 'i] ' <•) 



0 1 



1 0 



1 1 1 



1 1 1 



5 2 3 



inuilnl s .Mir sii-'S/iii •' .•( 
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C\s upper limit is dependent upon Lliu size of the table, being 
.816 for a 3 X 3 table, .866 for a 4 X 4, and .894 for one of 5 X 5. 
Thus a C of .68 from a 3 X 3 tabie would no about .83 if the ceiling 
were unity. 

Coet'f ic ient o f Agreem o in , K 

This coefficient was deviled by Jacob Cohen (see Educational and 
Psychological Measurement, 1960, 20, 37-46). It is similar to C in 
that it takes chance agreement into account by computing expected 
troquencies. It can be interpreted as the proportion of agreement 
between two judges when chance agreement has been excluded. It can be 
applied to nominal measures or better. However, it concentrates on 
the main diagonal of the table and is reduced by any reduction of fre- 
quencies in this diagonal. Thus, if t.here were a systematic bias 
between student and parent, then one s-ould find a K of zero even 
though C and r were high. This can be turned to advantage as will be 
seen. K is not affected by "coarse grouping" and always has a ceiling 
of unity. A high K always indicates a correlation coefficient at 
least as high as k\ if not higher. 

Product-Moment C or re 1 at ion 

In the extreme case- of a 2 X 2 table, this is synonymous with the 
phi-coefficient, but whatever the size of the table, values are 
depressed by the "coarse grouping" effect, though in a more complex 
fashion than is C; so once again, a value of .8 for a 3 X 3 tabTo can 
be regarded as higher Lhan its face value. 

Correlation is a measure of association, not agreement; and so 
svstoniat biases between responses Crom students and parents^show 
Little or no effect. i'nr examnle, if each student gave Father's 
I'dMcaLion as one category higher than cla med by his parent, we would 
get high correlation and om: in M .'y coe f fi c ient s , but a near zero 
coet f icient of agreepfnt . 

f;,,!Mr ''' llr ' l]i,n ' * ! - in-F-.', which presents Hie veri f ieal inn 

! ' ' ' * ' ■ ' ! 1 ' ' i ' * ■ " 1 ' ' ' ■ : ' ' < imI ! ha ! i nee I lie null hvp<it hes i s is 

i:i - i ; : ! ) '' ,5 ;-i"''i» " i:! 'hi-- •■■-.■•:■;!, i r:i i :" i .-a a. vs hav- n.. t been tested; 
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Verification Coefficients 
Student/Parent 



Item 

Mm (a) 


Item Description 


Item used in 

fltif i( ^ ti nnn;i i rp 

forms 


r 


C 

corrected 


r 
K 


r or 


N 


i 


Student's Race 




C,I),E 


. a) (b) 


,71 


.63 


— . 

.69 


— — 

294 


2 


Child resides with 


V I) i: 


S4 (h) 

.04 






(N.A.) 


i 

29/ 


3 


Father's educatior 


1) F 


hfi 


Hi 


Aft 


7Q 
. n 


14/ 




Mother's educ.it ion 


1) F 




Hi 


. /J 




US 

! JJJ 


! 


Attended kinder- 


f I) F 


fil 

♦ U J 






CO 

.o: 


296 


1 

1 


garten 














1 


[) 


Father's eniplovmont 


I) F 


Sl°' } 




. JJ 


"•n 
. i\] 


■ 

1 f t 

164 


1 


Library visits 




C D F 

IT' 






. J 




2% | 


! « 


litw far U\ schqol 


C.D.E 


.34 


Ml 


.4] 


.54 


292 


9 


School discuss 


.ons 


C.D.E 


.20 




.07 


-.05 


298 ; 




with parents 
















lu 


How good a stu 


lent 


C,]),F 


i21 (b) 




.OH 


.12 


294 : 


11 


How many ma^'i;/ 


hies 




.47 ■ 







.20 


.43 


297 ! 



(a), 



)ers in these tableware not from questionnaires, hut facilitate disci; 



ission. 



(b)„ 



(c) 



Iliese coefficients were inflated by the or • mce ot expected frequencies less than unity. 

Values in this column are corrected for th- ceil inj; value of the square table involved and, bv 
approximate method, for tin-presence of expected frequencies less than unity. 



however, the standard errors of the coefiicionts are of the order of 
.064 or less for the parent verification study and .088 or less for 
the teacher verification, so that the .95 confidence ranges are about 
± .13 and ± .17, respectively. 

?J-J^d_ent-Parent Qu est ions 

All values for r (or 0 -hen it applied) except for item numbers 
7, 9, 10 and 11 can be regarded as satisfactory. Items 9 and 10 
("School discussions wi:h parents" and "How good a student do parents 
want; you to-be") have no "verity" at all, in anv of the three senses; 
Lhere i,s not even any important disagreement, and cell values in the 
contingency tables are pretty well random. What the amplication of 
this is is hard to say ; , certa in 1 y we must assume that from a factual 
standpoint if parent statements here are to be accepted, student claims 
must be rejected as worthless. Conversely, if the items are still to 
be regarded as useful, we must ignore these parent reports and attrib- 
ute "latent" indications to those from the students. 

For two items (7, "Library visits" and 1.1, "How many magazines") 
the values for C are higher, and those for K lower, than r, suggest ing 
that there are probably systematic biases involved. With item 7, 
"Library visits" the picture is the same as with item 9. In this 
case we are interested in its contribution to a" scale\apping reading 
interest of the child. Also worthy of question is the ability of par- 
ents to estimate the number of out-of-school library visits— 
especially of older children. In contrast, item 1.1 was included i.n 
a scale called Reading Material Availability which was an attempt to 
reiU-ct the actual home environment, relative to reading material. 
The results cast doubt on this seaU-. 

The four best i terns are: 

2 . "i :!i i ] d n-s i di's w i t h " 

i. "Far her 1 s educ.it inn" 

4 . "Mother * s educa t i on" 

' j • "A I tendi-d k i nd e r ga r : ei ■ " 
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Ir.-ms 3 and 4 of Table I1T-F-2 are all included in our SES scale 
and have high K values which means that not only can we expect high 
reliability for this very important scale, but we can interpret stu- 
dent reports fairly literally, A scale involving these items, togother 
with item 6, "Father's employment," will have a reliability coefficient 
of about .94 and alonger" scale r:tiU higher. 

Te ther-Parent Qi je st ion s 

tn Table I I L-K-3 we have the three items from Questionnaires A * 
and B for which we can test the agreement of teacher and parent. For 
all three, the values are satisfactorily high. Only in one case, the 
last, is the difference between coefficients of agreement and correla- 
tion high enough to suspect the existence of systematic bias. Examina- 
tion ol the table itself appears to support this conclusion, with 
teacherV tending to give lower occupational levels than claimed by the 
.parent. There are ten nsiscJ ass i f / ca t ? -ms below the diagonal (eight n| 
one category only), win r parent claimed lower, but thirty above the 
diagonal of which six • r, i'or t -i or more categories lower in 

t each or 1 s est i ma t ion . 

fhere were ai. three items ("Student's nu e . " "Child 

lives with" and "AtU;<.!, dergarton" which were dealt with bv 

re; . -hers in OiH'stii « Iv, with Loo few :ases (26) to justiiv 
statistical treatmei'. ver, the number of p»-ruvt agreements were 

rrs.iect i vt 1 v 2 'I, 



■v, 



bus, over. ill, tl.. is ■ >od rea-e,n ; -c e.-' 'nlormation given 
by r * »aehers . 

' I'l 1 } • b e r - T i jj u h e r ih\ l 1 : .1 ions 

An »■>:. unation of Tahle I I I-F-a news that once again all correla- 
tions are satisfactory, even the lowest o| . r w for item 1 "> ("Child's 
confidence w i t li adults"). As an indicat .m, a 20- it em test with items 
ol the same reliability as this one could be expected lo have a reli- 
ibiliev eoei f icieiit in excess of H) — good , as 20-item tests go. 

Several iiuins in t h is * -^ec :■ i oe notablv items I A , Ih, 17' and M 
,,iVt ' sui-.st nt ia! iv higher r va i ue , than K , probably i nd t ea t i ng t ha i 
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I';ihk' lll-F-'l 

Verification Coefficients 
Teacher/Parent 



fa) 



I ten Description 



fathc education 



. v .". 1 '' : h education 



sr s c"i[)liiv 



Item used in 
ques ti Linnai. re 
forms 



A, II 



.()') 



corrected 

_L., 

i 

.75 



i , Mi 



,35 



M 



,75 



i 



— L 



iJtntiiK'j'.iji; in this table July, not quest i •uiaiiv i i era numb 



Table llt-R 



Verification Coefficients 
Teacher/Teacher 



Item 




Item used in 






No. M 


Item Description 


questionnaire 

f nrmi: 
LUililb 


c 


c 

corrected 


12 


Makes friends 


A R 


fil 




13 


Liked bv classmates 


A,B 








Behavioral age 


A, 8 

• 


.64 


.78 


1^ 
1J 


Confidence with 
adults 


A,B 


,61 


.70 


16 


Child's desire to 
learn 


A,li 




.76 


17 


How good a student 


A,B 




.87 


18 


Cliild's attention 


A,il 


.66 


.SI ■ 




span 









number for identification in this table only, not questionnaire item numhe 



that the time interval between the two applications resulted in systematic 
biases. Inspection of Table lll-F-4 did confirm a vague trend but nothing 
important: and probably not significant. 

Cone 1 us ion 

Although only in the last case (teacher repetition of questionnaire) 
can. we speak of reliability in the usual sense, there is evidence of 
satisfactory dependability of information collected by means of the 
questionnaires, whenever the content of the question is factual. For 
a few questions which are interpretive or a matter of assessment (e.g., 
"How often does student visit the library?") there is little agreement 
between parent and student. The effect, either way, on the main study 
is complex; even high internal consistency of judgment (as for the 
teachers) can theoretically be invalid; and even outright disagreement 
1 'tween student and parent could still leave us with useful information 
Horn the student. In fact, it appears that some possible future analyses 
might well explore the nature and extent of these differences in percep- 
tion between parent and child and the relationships of these differences 

to student outcome;. \. ;».!!'» ,,i !' r .>r«..-i hv-rcirn - , 

* ' J T ^ •••:■:!> lnratorv study in 

this iin-,1 -...'.i . -tv.fi if, -f : \ . 

ll - MI ' v,,|un,tl WI] 1 ''"vor result, t.f this stiklv. 
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:nmk:\ rs 

i\ ron t Vc r i.f i c\i t i un (Hies c i onn:i i 
lie r Vo r i i L r.i t i on (hies t ionna i rt 

Run i rule r Li- l tors 
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OH Ice of Management *and Budget 
No. 5 1-S72001 

Attachment 1 Approvai expires July 31, 1972 

AMERICAN INSTITUTES FOR RESEARCH 



Center for Research and Evaluation 

in the Applications of Technology in Education 



LONGITUDINAL STUDY OF DEMONSTRATION EDUCATION PROGRAMS 
PARENT QUESTIONNAIRE 





Student 


Number 
















8 


5 


STUDENT'S NAME 


1 


0 


3 




6 . 


7 


8 



Your child's school, along with 60 other American schools, is now taking part 
in a study of new and different school programs. The results of this si_udy, which 
is sponsored by the U. S. Office of Education, will be used to improve the educa- 
tion of children across the nation. We are asking parents to help by answering a 
few questions on the child whose name is listed above. Your answers will be used 
for research purposes only, and no one in the schools wili see them. 

Please ..return your compleLeu form boon as possible.. An addressed and 
stamped envelope is enclosed. When we receive it, we will be happy to send you a 
new Eisenhower dollar in a plastic display case in appreciation of your coopera- 
tion. 

INSTRUCTIONS 

Mark an "X n in the parentheses .to the. left of the arswer you choose for e-jc i ' • 
question. Choose onJ y one answer for each question. 

SAMPLE QUESTION: 

How many brothers and sisters does this child have? 
1 1 ( ) . . . None 

2 ( ) . . .n:ie 

3 OO.-.Two 

4 ( ; . . .Three 

5 ( ) . . . Four or more 

Tin- child has twn brother ; .snd listers, so the parent who answer t.-d the sample 
quest, i en marked an "X" In tlie parentheses Lo the left of "Two." 

A • I • R <C> CRE.ATE no oox nn palo alto. California ©4302 (location i^oi arastr adcro road) □ Tr».. kiisi 403-3550 

CABLE A D O R ESS A I R tOC A RCM f P A LO ALTO 
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PARKNT QUESTIONNAIRE - FORM A 
Grades 1 and 2 



i<l\.-A is LhxS en i Id's date 01' 
birth.' 



Month ' Day Year 

Is this u 

. - ■ ' r i en la 1 

. , /u-.Htr i l : a n 1 nu ian 

. . =2 lav:k 

. Cuban, Mexican ur Puerto 

Kiv: in descent 
. oviitc (other than of Cuban, 

Mexican or Puerto Rican descent) 
» 0 ther 

> i Mi w:u»m doe; LP. is child ILve? 

. :.et:i a rents (real or a do p Led) 
./'.other hut not father 
. Fa tiier hu l not no tiier 
. trier relatives 
. Nor. - re la t i ves 



n.it i ■« L:;e level o f education of 
nis I'iiiLd's lather (or male head 
r aoa^eiicld)? 

. ; ' rac e nc aoo 1 

. '^l' 1 i e l\ e 

. I-n'ie.-n't currently ii.ivu a male 
: .« -a J c ! lnuiSf.'hfi id 



l 4 * VII. Wna? kind of work does the 
child's father (or head of 
hociehoid) do? You may not 
fir c'- ict job listed, but 

or* 5.1 . ore cn;,'c comes closest 

' » his main_ job if he 
wor ■ . mo i c than one job. 

1 ( ) . - . Workman or laborer - such as 

fac tory worker , cook, gar- 
dener, maid, bus driver, 
gas station attendant, farm 
worker, waiter, waitress 

2 ( ) . . .S killed craftsman or foreman - 

such as carpenter, mechanic, 
plumber, electrician, factory 
foreman, pol'ceman, draftsman, 
technician, beautician, seam- 
stress, enlisted man in armed 
services 

3 ( ) - - . Office worker or sales clerk - 

such as bank clerk, store 
clerk, bookkeeper, mail clerk, 
office worker, secretary 
^ ( ) * ■ - Professional - such as teacher 
doctor, engineer, lawyer, 
.scientist, dentist, social 
worker, public accountant 

5 ( ) . . . Manager or business owner - 

such as store or office 
manager, banker, business 
owner, farm operator or owner, 
government official, military 
officer, real estate or 
insurance salesman 

6 ( )...The father (or head of house- 

hold) doesn't work 



Off!.-* of M. 1: lu.-:,vU im^rt 

So. 51 - ; .'; i! i 

Appruv.il i-nfurvi July H , 1 '.' / J 



AM£*ICAN INSTITUTES FOR RESEARCH 



f 't ntcr for Rest arch a n <i r.valvation 

in the Applications of Technology in Education 



LONi;nruiNU study of dkmonstration education programs 

IVvailNT 01 KST1UNN.V 



ST L : 01 'NT 1 S NAMK 


Student 


Number 
















a 


b 


i 
















^ u u r child's s c i 10 o 1 , alcii,; w i ! ; \ u u o l i i e i Am l: r i i \ i n ;c 1 iou 


i • . , 


i s 


now t 


al< i 




par 


t 


in a study ot new and dilfcrent school programs . I'iu- re .suit 


s o r (. 




study 


, whir 


h 


is sponsored by the U . S. Office ot Lduc.it ion, will be used 


to 


i iv.prov 


e the 


edu 


c a - 




Lion of children a»:roos ^Lhe nation. V.'e are a .ski in; parents tu help 


by 


an 


S W L' 


r i n 


>; some 


questions on the child whose nair.e listed abuve. Your ans 


w e r s w 


i.l 1 


n e 


US 


ed 


for 




researcii purposes only, and no one in L.'ie s.iiooU, will ^-<- them 
















P Loa.se return your completed loi:. a^ -con as possible. 


An 


add re 




d and 






Stamped envelope is enclosed. ,/aen we receive i L , we will be hai'n 


'.' to s 


end 




u a 




new 1 i.ser-hower dollar in a plastic display ea.-,e in appreciation 


ol" 


you r 


coo 


per 
C 


a Lion. 


INSTKll L'lUNd 


















Mark an "a" in tnv parentheses to the i^ii of the ,mswe 


i" you 


: "■ i 




fo 


r" e 


ich 






3 u es L ion . La 100 s l o n i 



tie ^u; ;wvr • or 



jUe S t It 



s t;i:s chi hi ii. 



SAMPLE Ob' LIST 1 UN : 

How many brothers ,i:id si ;tcr.i 

1 ( )...Noile 

J ( ) . . .one 

J ()0...Twc 

*■» i. r i.-c 

j ,) . . . Kou r u r mo r i_- 

i iu cniid a, i ■, two br;t.H. : rs -nd -, isters, ;o the parent who aiv 
-juestioa mara.eu ,m "a" in t hi- ... • e:H , M the 1 »M l o. "iwv." 



1 P 1, 
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PARLNT QL'LSTlOiN.NAlKL - FORM B-! 
tirades j through U 

1 



What is Litis child's d.^Le oi birLh? 



MonLh ' Uav Year 



. is this c h i Id 
) . . .0 r i en ta 1 

) . . . Amer Lean I iui ian * 
) . . .i;lack 

.) . . .01 Cuban, !! L'xii'.iii , or Puert 

Ri.can de.-.c e:» • 
) . . .Wiii te (ft .■■) ( ban o t duba*' , 

Mexican oi" 'I'a-.'fLo Ricn desi 
) . . .Other 



i I h w::u;\ dot 



si hi ! iv. 



, . Both parent h 

, . Mi 1 L her hut not f a t her 

, . Father I hi t not mother 

. Other relatives 

. Non-rein l i ves 

.No one 



;iuw i a r d i i 
i n sc boo 1 ' 



a L ; h 



) - 



.Grade ML'iiool 
.Some hh'.h s»_ uoo J 
. o radua ted I ru::; i i i >; s i .;c:iuoi 
. .Some i cl Le/.e Ci -J yiMr.ij 
.Graduated i rom a I our -'.■•.Mr 
cuI.1l-. e 



t i t i" a 



. radt 
■Joi'u ;:i 
Jradu it 



• r aacia i 



3 v« a" , ) 

» Oil I*-"- . 



VI. Did this child attend kinder 
^.11" ten '.' 

( ) . . . i"es 
( ). . .No 



V I I . What k i nu o i wo rk does this 
ch ; 1 d ' s tat lie r (or head o f 
1 1 uu s e I io 1 d ) do'.' Y o u n; a v not 
find the exact job listed, 
but chock Liie one that comes 
closest. Mark on L y his ma i r. 
job if he works on more than 
o ne jo I) . 

I ( ) • • . Workman or laborer - such as 

factory worker, cook, gardener, 
maid, bus driver, ; j,as station 
attendant , I arm worker , 
wa i ter , wa i t re.-.s 
~ ( ) ■ ■ . Skilled craftsman or to rem, in - 
such as carpenter, mechanic, 
plumber , electric: ian, fac to rv 
t oreman , pol iceman , draftsman, 
technician, beautician, senm- 
s t r e s s , e n list ed ma n in 
armed serv ices 
J ( ) . . . Of f ice worker or sales cl erk - 

such as bank clerk, store clerk, 
bookkeeper, mail clerk, of fi co- 
worker , sec r u t a r v 
^ ( J ... Pro f ess i onal - such as U'i!nr, 
doctor, engineer, law\er, 
scientist, dentist, soc ia 1 
worker , publ ic accountai: ■ 
J ( ) ■ ■ . Manager or business uwru ■ - 
such as s Le re or of f i c e 
manager , banker 1 -, bus i no- 
owner, i arm operator »>r aier , 
iioVe r :i;:.en t ul ! i c ; n i . ■ . i 4 : L . i j - • ■ 
oi f i cer , rea I esta t . or 
i i'sur in.-e sa 1 » ..m.ui 
h f j . . . 1" he i , . tin.- v ((j r ik '.id I hen: * - 
;iol a ) a.-.- ai ' ( .....r' 



/ 
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VI II. How ol tea does this child go to a 
public library or bookmobile (not 
the school library)? 

( ) . . .Once a week or more 
( or 3 Limes a month 

( ) . . .About once a month 
( ) . . .A tew times a vear 
( )...Never 

1a. hew iar ia school do yuu want thi; 

Child to ; ,;o ? 

( ) . . . juii 1 1 care 

I ) . . . K in i sh h i^n schooi 

{ )...Attend junior cuiie^e, busiuesr 

or te.'imieal sciioc! lor i or 2 

yea rs 

( )... Graduate ire::; ,i i our-war 
coli'e, ; ;e 

I ) . . .Professional ur : ;radua u- .-school 
a l" teT co J 1 ec,e 

how ot ten do you and this cniLd 
talk about his or her school work.' 

( ; . . . lust about every day 
( ) . . .Once or tw i c e a 
( ) , , , Less than one e . i w< 

Al, how coed ,i .-.tlldiMit. ui) vou 

cii i id to in ! 

( ) . . .One i>l tne be*>l 

( ) . , -A how average 

(. ) . . .About average 

< ) * . .Jon ' t 

aM, how ::.an, 
t i L i (1; i 
r ..-cul.tr! .■ 

f ) . . . 

f J . . . i i ' r J 
( ; . . . J u r 

( )...') er 

r or :•, 
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American Institutes for Research 



Center for Research and Evaiuaiicn 

tn the Applications of Technology in Education 

LONGITUDINAL STUDY OF DEMONS! RATION EDUCATION PROGRAMS 
TEACHER QUESTIONNAIRE - DATA VERIFICATION 

• You will recall that your school district is pa r t i cipa L ini» in a Lonfc i tud in.-. ] 
Study of Educational Programs involving mo e than 20,000 students in 13 school 
districts throughout the U.S. The study is sponsored by the U.S. Office of Edu- 
cation, and is intended to identify -md docu-ent educational efforts and their 
effects on student achievement and motivation. These findings will be used in 
the design of new educational programs across the nation. As part of this study, 
we need to verify o.rtai. information previously obtained from teachers In the 
Y irticipati..^ districts. The in.forn.ati you fill in should be for the child 
whose name is listed on lmc.i of the included questionnaires. If at all possible, 
the teacher filling out this form should be the one who previously provided sim- 
ilar information to the A.l.R. Longitudinal Study. 

The answers you supply to this questionnaire will be used for research pur- 
poses only and will be treated as confidential. Responses to the questionnaire 
WLl not be identified by name in any reports to USOE or to the schools. 

Your prompt completion of this questionnaire will make an important contri- 
bution to the Longitudinal Study. Please put the completed questionnaire into 
the envelope provided and return it to the school office. We wish to express our 
appreciation for your contribution t«. the^eess of this research. 

INSTRUCTIONS 

Mark an "X" in the parent!), ; to the left of the answer you chous* 
each question. Choose only one .nswvr for each question. 
SAMPLE QUESTION: 

What school subject is this ,.hild , - : UiVorite? 
1 1 ( ) . . .Music 

1 ( ) . . .English 

3 (M) . . .history 

4 ( ) . . .Art 

5 ( ) . . .Some other sub ject 

, Tht " L "- achur who answetv '- ^ saxnpLe question felt this child preferred 
H\^ory, so he marked an in the parentheses to the left i "Historv " 

•RO CREATE PO BOX 1113 PALO AOO^IT 



o r 



i.tr 0 RN,* V4J02 .LOCAT.ON: 170, ARAtTRAOEPO ROAD) fj TEL ,4.8,493 3550 
CAPLE ADDRESS A I RESEA RCM / PA LO AUTO 
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TEACHER QUESTIONNAIRE - ')ATA VERIFICATION 



trades 1 through 5 



STUDENT 1 S wAME 



Student Number 
















9 


b 


i 


2 


3 


4 


5 


6 


7 


8 



1 1 



1 2 



10 



1 

2 
3 
4 



I. Do you recall answering the fol- 
lowing ues r ions for this child 
previoi 0 

( )...Yes 

I ) ... No 

( ) .. .Unsure 



LI. In my opinici., Limo ::hild miikes 
friends eas i I ■' . 

( ) .. .Yes 
( )...No 

( ),..! am un: : .ble to say 

Does this response indicate a note- 
worthy change ir= -.he last month? 

( ) Yes 
( ) No 

III. r i relation:;' ;ips with other numbers 
of i *-;e class this fhild is 



( > 
( ) 
( ) 
( > 



IV. 

( ) 

( ) 

( ) 

( ) 



. , . Aggre? si ve 

...Of aveie"^ force fulness 
, . .Passive 

. , .1 am unable to say 

'. jqs this response indicate a note- 
worthy change in the last month? 

( ) \..5 

' ) No 

'Pi is child acts 

...Older than his age 
. . . About his age 
. . . Y o un ge r t h a n his a go 
...I am unable to say 

Does this response indicate a note- 
worthy change in the last month? 



( ) 

( ) 



Yes 
No 



V. In relationships with adults, 
this ch i Id is 

( )...Very confident and self-assured 
' )., .Moderately self-assured 

} . . . insecure 
v ' - . , 1 am unable t-j say 

Does this response Indicate a 
no teuort.hy change in the las t 
month. 7 

A ) "es 
( ) No 

V 1 . 71i i s child's desire to lea rv, i s 

( ) . . -Above average 
( ) ... About average 
( ) . . .Below average 

Does this response indicate a 
noteworthy change in the last 

m ° nth? ^ ( ) Yes 

( ) No 

vll. H c"-. f gooc a student is this child? 



ill- : 



( ) . . .On- : of t^e bes t 
( ) . . .Above av_/age 
( ).. .About a\/er^ 
f. ) , , .Below average 

Does this response indicate a 

noteworthy change in the las t 

month? < 

( ) Yes 

( ) No 

VI LI. j is child's attention span is 

( )... Longer than most others in 

.. s class 
( t ) . . About ave rage 
^ )... Shorter than most others 

Does this response indicate a 

noteworthy change in the last 

month? , v 

( ) Yes 

( ) No 
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BEHAVIORAL SCIENCE AND TECHNOLOGY PROGRAM 
P.O. BOX 1113, PALO ALTO, CALIFORNIA 94302 
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I.i)NoLTUL)INAi STUDY 0'- r ai : 'UkS \'\< \ : a>.\ Li) U CAT I ON PROuKAMS - i'MUIM QUEST I ONNA i K! 



S l ud out S N ar.ie 



A couple j t w eekh . i ,;r y u should ha v e r ci e i v t • e . i Y y r ::: v : ; 1 ^: i i ab k e d v o , s 
answer some questions about Liu- child wl. se j i»:«a ;s v,riLlen abu\.-. We 
i:.iv.j not yet revived y ir fur ., and a; e ^»>iidin«; .a. other l in >' is t j the . ast 
•• ..• has boor. lost. U'j auld :j, ^rateful to yuu i: uu would answer the 
jUesLions fur Lias child usin- Liu: s- :iped, addressed envekv-' . n< lo.-ed. 

Your en i Id's scn.'oi is uo' ■ taking part in ;tudv «■! ; ■■■■ and difhaei, 
setieol programs. T e -fs.ilL: jf this study, v : L h is sp< ns< a »'d by the U.S. 
OiL-'-u of Education, will be u lu improve the education a .'hildien a toss 
tut- ,. tion. We are askL- part as to help by answr-in); uur questions. Your 
answers will be used for research purposes or . y and will bt kepn confidential-. 

Please send your c.-'pl- '.eu i urm as as possiaU- i ..1 we wiJl then 1).' 

happy to send you a n*-w Kin .he . a* dollar in approi : atit a vuur help. 

S i nc t r f e ] ; , 



A i be r t ■ "Ch, i J up si-; v 
f ,"ui;r.n.i i) i rec tor 



A hi, :,ti 



8>: 



Location: 1791 Arastradero Road • Cable: A I RESEARCH ' PALO ALTO • Tel: (41b) 493-3550 
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AMERICAN INSTITUTES FOR RESEARCH 



BEHAVIORAL SCIENCE AND TECHNOLOGY PROGRAM 
P.O. BOX 1113, P..LO ALTO, CALIFORNIA 94302 



I.tO-i: I iTD I NAL SFl'DV i I KA L i ; >N s.jL'UA 1' ION PKiH'.KAMS - i'AKi-.Vi" of K ST 1 1 >NNA I i< h 



iU .1 1" i' irnu : 

A-i vou ma v r * •riL-i'-iiu 1 r , it v - 
v «. - iv c \ 1 1 i u s sen o u i i t fir. Lii 
pri\^rai::s. This study, which i 



ir r:in ii'i L»'f«; :iavi nri-i; r • ■ i.- i v..\ \mm , 

\ii"L in a stiuiv m ana a i i ; vivnt ■ ; »* i u >* ■ 

> sup[.HM'Lt.'d 'nv tii' I". S. i'i ! <* o I iviiii.it it 



; r • «. i > i 
i • r i ■ i ■ i ■ i v • 



i 1 ] in- usiM to Lnprovu raueat u>n across t iu- nat inn. 

Your L'uplv Lo i»ui- fj'irsL ionna i r* is important.. it. will -a 
com. i a\:u t i a 1 , ar.a will in- n.-L-.i i or research pn r post-s fr.lv. mi 
your i" u;:ip] u t u J form, wi.* will so:ui you a ir-w 'asenhova r tiollar in appr it i a- 
t ion o i your hul p . 

Pk'asc do answi-r Li:u rfiw/s t i ons about, your ihil.i, and rrtnirn Liu::) t.c u; 
in L:u- s tan pea, add r t_*sst.-u t.';;vL Lope unalosL-d. 



S i iu'l -r» 1" 



;> i r.-, i ' v 



Location: 1791 Arastradero Road • Cablo: Al RESEARCH /PALO ALTO • Tel 415) 493-3550 
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BEHAVIORAL SCIENCE AND TECHNOLOGY PROGRAM 
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-'I 1 ir t .i rent. : 



>u r 



l • .-j v; 



:.L i. 



ii- i '-i Ls:;i,i7 cor. 
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Location: 1791 Arastradero Road • Cable: A [RESEARCH /PALO ALTO • Tel: (415) 493-355u 



APPENDIX II 



Items and Item Alternative Weights Used 
in the Computation of EdExAG Scales 



ERIC 



.v. lie 

ion M Objective 



•ti'ro anil it t m A 1 ern.it ive >Mv}\\* lis,, 
in llie Comnutnt ion of KJKxAt: Scales 



.ihnrev. 



Scale I [ lT;s 



■ i' TluTt' R'ritti'n i)b- 



i a' lives 1 .' 



'Wt iv,s in liili.iv- 
ior.il Ttras 



- ICS 

- No 



ICS 



Alternatives 



.,i;i 



['.valuation ['sod [, 
i-onf i nn i)b| cot iv,s 



'tea /] 



•^'•r;i:i! Influence on 
irealaeat i'h.iraecristi. 



lusiittii ion Ini In- 
enced Choice of 
Treatment 



I!" 



i es 
No 



.cm n 



Consul l ant's ;\ol, 



Iteir, 



i ' to 11 -time 
- - Part-time 
I - nil consultant 



■'Pecai fuiniiiu' 



Item 21 



i - Vcs 



Staff an;! Materials j/.eu;.; 
a inn 



, , . leacaer hva.aal ion ]hm - u 

hva ii.i i mi ,. 1 1 cm jj 



Procedures 



' - Yes, by supervisory ratings 

! - Vcs, by peer ratings 

1 - U's, by class performance on 

achievement tests 
i - Vcs, by some other method 



No 
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Items and Item Alternative Weights Used 

111 d'mpulat ion Edb;AC S , ■ . M t ■ ; lOuitii 



Scale 



Staff and Materials 
Evaluation (cent.) 



Abbrev. 



Scale Iter. 



Materials Evaluation 
Procedures 



Alturnativt'! 



Item 32 

3 - Individual teacher judgment 
3 - Teacher committee judgment 
1 - Other systematic procedure 
1 - No particular evaluation pro- 
cedure 



Administrative Evalua- 
tion Procedures 



3 - Yes 
1 - «o 



Item 73T 



Treatment Evaluation 



E-TE 



I n forma 1 Classroom 
Tests 



3 - Yes 
1 - No 



Item 



Standardized Achieve- 
ment Tests 



3 - Yes 
1 - No 



item MS 



Are Evaluative Pruceu- 
ures Systematic? 



- Yes 

- No 



Item 75T 



Evaluation by Admin 
t rat ion 



Evaluation by Teache.'s 



No 



3 - Yes 
1 - No 



Item /f.'i 



Item 77T 



ERIC 



Evaluation by Research- 
ers 



3 - Yes 
1 • No 



Item 78T 



(Continued) 



( Items and Item Aluviiat-HV kVUhts M ' 



Scait 



Resistance to Treatment 



Abb iv v. 



■RT 



_ Scale Jtems 

Resistance from S L i 
dents ■ 

/ 
/ 

/ 



Alternatives 



Item 2') 



i - A fi ear deal 
1 - Some 

I - Little or none 



Resistance i" r om feath- 
ers 



! te!ii 24 



A ;;reat deal 
Some 

Little or none 



Resistance from. Admin- 
istration 



item i r ) 



3 - A i;reat deal 
3 * Some 

I - Little or none 



School Support Staff 



Resistance from Con- 
mnnitv 



''omiseiors 



Item 26 

1 - A t;reat deal 
) - So:ne 

L - Little or noni 1 

Item 47, 

1 - At the school full-time 
! 2 - At the school part-time 

2 - At another location, by 

appointment 
1 - None avem, 



ERLC 



Learning Disability 
Therapists 



Item 48 , 

') - At the school full-tine 

1 - At the school part-time 

2 - At another location, by 

appointment 
1 - None available 

(Continued) 



If 



Items and Item Alternative Weights Used 

in flu* Couipiiutii'ii ii| Uh.\{\ Se;iK'S I ('.Mil iiiiinl ) 



Scale 



School. Support Staff 
(cont.) 



Abbrev. ( 



Scale Items 



Hone/School Liaison 
Staff 



Yes 
No 



Alternatives 



[.tern 49 



ibrarian 



Individualization in 
Decision Making 



L- 1 DM 



Topic Selection 



\ 



J 

Materials/Text Selec- 
tion 



• Item 55 

3 - Full-time librarian 

2 - Part-time librarian 

1 - Library, but no librarian 

1 - No library 

item 35 

3 - Student only 

2 - Student and teacher 
i - Teacher only 

1 - Treatment dictates topic 
selection 



3 



item 36 



Student only 
2 - Student and teacher 
1 - Teacher only 

1 - Treatment dictates materials/ 
text selection 
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Sequencing Decisions 



Item 37 

3 - Student only 

2 - Student and teacher 

1 - Teacher only 

1 - Treatment dictates sequencing 
(Continued) 



Items and Item Alternative Weights Used 

in the Computation of KdKxAf; Soolos (Continui-d) 



Scale 



Abbrev. 



Scale Items 



Alternatives 



Tef.cher or Locally Devel- 
oped Materials 



E-TLDM 



Externally Developed 
Materials 



Item 7 

3 - Little or none 
2 - Some 

1 - Almost exclusively 



Individualization of In- 
structional Pace ■ 



Use of Studei.ts in Treat- 
ment 



E-1IP 



E-UST 



Dependence on Locally 
Developed Materials 



Instructional Pace 



Student Helpers 



Item 60 

3 - Complete dependence 

2 - Some dependence 

1 - No dependence 

' Item 38 

3 - Individual determi ncs own rat 6 

2 - Individual and group pacing 
1 - Group pacing. 



Item 43 



3 - Yes 
1 - No 



Utilization of Treatment 
Evaluation 



E-UTE 



Classroom Use of Stu- 
dent Helpers 



Evaluation Used to 
Modify Treatment 



Item 44 



3 - Instructional 

2 - Tutorial 

2 - Other 

1 - Clerical 

1 - Not Used 



3 -Yes 
1 - No 



Item 72T 



(Continued) 



m 



Items .and Item Alternative Weights Used 

1,1 tik ' ^ipiit;uioii iif Hdl'lxAH St.il^ (Cnuiimi-. 



Scale 



Abb rev. 



Use of Community Resources E-UCR 



J 



Scheduling Characteristics E-SC 



Use of External Incentives E-UEI 



Scale its 



Human Skill Resources 



Natural Resources 



Neighboring Institutions 



Scheduling 



External Incentives 



Alternatives 



Item 52 

3 - Use is. an integral part of the 
treatment , 

2 - Some use made of them 

1 - No use' made of them 

Item 53 

3 - Use is an integral part of .the 

treatment 

2 - Some use made of them 

1 - No use made of them 

Item 54 

3 - Use is an integral part of the 

treatment 

2 - Some use made of, them 

1 - No use made of them 

. . ' • Item 33 

3 - Flexible scheduling 

2 - Traditional class period with 

some variation. ', 

1 - Traditional class periods 

Item 40 

3 - External incentives are an 

• important part of the treat- 
ment ' » 

2 - Some incentives used 

1 - No external incentives are. used 



(Continued) 



Items and Item Alternative Weights Used 

the Compute ion nl IMi' xAC Scairs [Can itnu 



Scale 



Use of Performance Agree- 
ments 



r. School-Classroom Design 



Abb rev. 
•E-UPA 



Classroom Group Organiza- E-CGO 
tion 



E-SCD 



• Scale Items 

Performance Agreements 



Classroom Organization 



Unique Architectural 
Features 



Classroom Structures 



Alternatives 



Item 39 ' 

3 - Is a major ingredient of the 
treatment 

2 - Used for some areas in the 

treatment 

1 - Not used at. all 

. Item 34 •■ ■ 

3 - Flexible groupings 

2 - Fixed group with some flexible 

groupings 'at some times 
1 - Traditional fixed group 
organization 

Item 28 \ 

, 3 - 'New buildings were designed 
. 3 - Extensive modifications were 

required in existing buildings 
' 2 - Simple modifications were re- ' 

quired in existing buildings 
'.1 - Not at all 

Item 63 

3 - No partitions— open space 

- 2 - Multiple classrooms separated 
by movable partitions 
\r Ordinary classroom (4. dis- 
'*• tinct walls with a door) 

(Continued) 
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Items and Item Alternative Weights l.'s-eii ' 
in the Comput ;iUori oi \\\h\<!. SeaLs (C»ni inued) 



Abb rev. 



Teaching Unit Comoosition 



/ 



Status of Treatment 
Implementation 



E-STI 



Scale Items 



Teaching Team Size 



Classroom Tse of S 
Adult Aides 



Status of Treatment 



Longevity of 
Treatment 



Alternatives 



Item 41 ■ 

3 - Team teaching in a classroom 
2 - One teacher with paid aides ' 
1 per classroom ; 

2 - One teacher with volunteer 

.aides per classroom 
J - One teacher, per classroom 

■ Item 42 * 

3 - Instructional 

2 - Tutorial 
2'- Other 

1 - Clerical 'or supenfisiyn 

1 - Not used' 

Item 1.8 

3 - Pilot' study or experimental 
J - Regular part of curriculum 

Item 19 . 

3 - Less than 1 school year ' 

2 - 1-2 school years 

1 - 3 or mpre school vears 



(Continued) 
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Items and Item Alternative Weights Used 
tlu' Computation of l-JI-yAC Scales (ContimifJ) 



Abb rev, 



Scale Items 



Alternatives 



KIP 



-T 1ST 



E-AL 



Special Instructional 
Materials 



i'sV of IV As 



Amount of I use rv ice 
Training 



Accessibility of 
l.ibrarv 



item 50 

3 - Package provided entire subject • 

matter instruction 
2 - Regular materials supplement 

special materials 

2 ■ ackage is a supplement to 

regular subject matter instruction 

1 - No special instructional package 

provided 

Hem 61 

3 - Textbooks are not used 

3 - Other materials used but 
supplemented by textbooks 

2 - Textbooks are used but sup- 

plemented by additional material 
1 - Textbooks are used as the' 
complete source with no 
additional materials 

Item 30 

3 - More than 2 weeks 

1 - between 1 and 2 weeks 

2 - Three davs to a week 

2 - One or two davs 

1 - None 

, : Item 56 . 

3 - Free access any period during day 

2 - Scheduled use during school hours 
2 - I'se after school only 

1 - S'o librarv 

(Continued) 
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Items and Item Alternative Weights Used 
in the Compucat ion of EdExAG Scales (Continued] 



Scale 



Use of Media Center 



H 
H 



'Utilization of Student 
Evaluation 



Abbrev- 



E-UMC 



\ 



■USE 



Scale Itens 



Use of Media Center 



Classroom Use of 
Tests 



Tests Used for 
Evaluating Student 
Needs 



Alternatives 



Item 5/ 

3 - Extensive use 'made of them 

2 - Some use made of them 
1 - No use made of them 

Item 67S , 

3 - Achievement sequencing, pacing 

and revision of materials 
1 - Achievement sequencing and pacing 
1 -• Achievement measurement onlv 

with no effect on treatment 



Yes 



Item 70S 



Evaluation Used to 
Modify Student's 
Treatment 



3 - Yes 
1 - No 



Item 72S 



Affective Evaluation 



E-AE 



Affective Data Col- 
lected for Evaluation 
of the Treatment 



1 - Yes 
! - No 



Item 74T 



Affective Data Col- 
lected for Evaluation 
of the Student 



3 - Yes 



No 



Item 74S 



J 0 
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Scale 



Mechanism for Reinforcement 



Opportunitv fur fraeti 



ce 



Iteis and Item Alternative Weights Used 
^' Computation of KdExAC S.mKs rCont inued) 
Abbrcv. 



t-OFC 



Scale Items 



Alternatives 



Mechanism for Reinforce- Teacher verbal praise 



nient 



Opporhir ■ for 
Practi 



Cranting a student a privelepo 
Tangible reward 
Other (Specify) 

Almost always 
Some times 

lallv not the' case 



These alternatives were 



not assigned integer weights, 



/ 



no 



APPENDIX i 1 I-K . 

Items and Item Alternative Weights Used in the 
Computation of Classroom Documentation Scales 
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Items and Item Alternative Weights Used in the 
Computation of Classroom Documentation Scales 



kale (Abb re v., 



Degree of Grouping (C-DG) 



Scale Items 
Degree of Grouping 



Focus of Activities-Cognitive (C-FAC) Cognitive Activity 



Alternatives 
3- Individually 

3- Individually and in small groups 
2- In small groups 

2- Individually and in large groups 
^-Individually, in small groups and 

large groups 
Hn large groups 

1- Small groups and large groups 

"J-Most students 

2- Abuut half 
1-Few students 
I -None 



Focus of Activities-Affective (C-FAA) Affective Activity , 3-Most students 

I 2-About half 
I - Few students 
I- None 



Use of Materials (0 



Printed Materials 



Visual Materials 
Audio Materials 



)-PreseiU, in use 
2-Present, not .in use 
hNot present 

^Present, in use 
2-Present, not in use 
I -Not 



J-Prescnt, in use 
2-Prwent, not in use 
I -Not prist 



continued) 
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Sea If (Abb rev.) 



Scale Items 



Alternatives 



Classroom Environment (C-CE) 



Study Arrangements (C-SA) 



Manipulative Materials 3-Present, in use - 

2-Present, not in use 



. Instructional Guides 



Lighting Conditions 



Heating/Ventilating 
Conditions 



Sound Conditions 



Space Per Student 



Flexibility of 
Seating 



Privacy 



\ 



l-Ni 



3-Present, in use 

2- Present, not in use 

1- 'Nojt present 

3- Excellent 

2- Av^rage 
bUnsatfs factory 

3- Excellent 

2- Average 

1- Unsatisfactory 

3- Excellent 

2- Average 

1- Unsatisfactory 

3- Excellent 

2- Average 

1- Unsatisfactory 

3- Excellent 

2- Average 

1- Unsatisfactory 

3- Excellent 

2- Average 
l-Unsatisfactory 



(continued) 



I 



Sr. 



... -Scale Items" 



.,__ i .2_ Alternatives 

- . ' ' 2-111 school;, .easily available to 

student 1 

.) • 

1-ln school, available only with 
scheduling 



llii 
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Visual H.' 



■None available 



! ' ; J " In classroom, easily available 

Mn school, easily available to 
student , 

1- [ n school, available only with 
scheduling 

O-None available 

Supplementary i , n , 

Printed Materials SSr " llm ' ° ; ' sily avai ^ 

2 - In school, easily available to 
student 

NTn school, available only with 
scheduling 

O-None available 
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Guidelines for Use of the Classroom Documentation Form 



Ove rview : 



The purpose of classroom documentation is to add to our understanding of 
educational experiences (treatments) which we have identified at each school. . 
By looking in one classroom chosen from the set of classrooms receiving a 
particular treatment, we are able to obtain new information not previously 
collected by interview methods. We are also able to verify certain informa- 
tion previously obtained by interview methods. It is important, to document 
both language art s and mathematics since criterion measure^ of achievement 
growth are being obtained by CTBS in these two areas. 

A very short documentation forr. has been prepared comprising some 21 n< 
items and four verification items. All site- visi tors should study the follow- 
ing explanation of those items and the examples given before attending the 
training sessions on the use of the form. Videotapes of classrooms from two 
sites will be used to practice in the use of the form. Our objective in studying 
the explanations and practicing with the form is to increase inter-rater 
reliability for al l obtained information . Toward that end we ask that site 
documenters apply the explanations and guidelines as given with a minimum of 
personal interpretation or redefinition. 
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CLASSROOM ENVIRONMENT 

a 

The intent is to describe the physical environment in which learning is 
taking place and to note whether the circumstances are favorable or unfavor- 
able. 

Ligh ting conditions are defined as adequacy of illumination and 
sufficient contrast to make most educational materials clearly 
visible throughout the room. Inadequate means globe lights, 
glare or major e/ontrasts throughout the room. Adequate means 
conditions support rather than hinder learning. Excellent means 
illumination is "ideal," that is, evenly distributed throughout 
the classroom and there is a light level on work surfaces so as 
to be suitable for reading fine print. 

Heating/ventilating conditions are defined as temperature and 
humidity balance throughout the room. Inadequate means the room 
is too hot or too cold, or is stuf r v as a result of unsatisfactory 
heating or venti lating controls . Adequate means conditions sup- 
port rather than hinder learning. Excellent means the room is 
mechanically climate-controlled, that is, an "ideal" climate is 
maintained regardless of weather conditions. 
• Sound conditions are defined as the acoustical qualities which 
enable the hearing of instructional content while at the same 
time suppressing ambieni noise. Inadequate means bare floor, 
ceiling and walls. Adequate means conditions support rather than 
Hinder learning. Excellent means that acoustical treatment is 
evident in carpeting and wall or ceiling treatment so that re- 
verberation is nil and transmitted sound from external sources 
is suppressed. 

Example //I . A room is old, wood floor, bare wal-s, gh -ghts, black 

chalkboard, sunny side of the building, with radiator healing. Score 1 
on lighting, 1 on heating and 1 on sound. 

Example //2 . A portable room has acoustic tiled walls and is carpeted wall- 
to-wall, has a number of "soft" florescent lights, a green chalkboard, and 
has a free-s landing ; stove heater. Score 3 on lighting, 1 on heating, 
and 2 on sound. 

r I [-1-2 
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STUDY ARRANGEMENTS 

The intent is to document the facilities for study, in terms of space, 
flexibility and privacy. 
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Amount of study space per student is defined as the availability 
of table or desk surfaces ample for the reasonable spreading out 
on ins true t ional materials . Adequate means suf f icien t room to 
spread out a workbook, notebook and tablet to be worked on simul- 
taneously by each child. Inadequate means insufficient room to 
spread out such study materials. Excellent means sufficient room 
to spread out these items plus additional work surface space be- 
ing available to each child. 

Flexibility of seating arrangements is defined as the relative 
"fixedness" to the room seating. Inadequate means fixed seats 
o rN^iovab^le^b u t no room for any thing but conven t ional rows . Ade- 
quate means that some rearrangement is possible but that furni- 
ture design or space limitations fall short of being ideal. In 
the case of large tables use reasonable judgment as to the prob- 
ability of its being moved for instructional purposes. Excellent 
is the .provision of small tables or desks that are designed for 
easy rearrangement and the avai lab i li ty ,c of plenty of room in 
which to move them. 

Opportunity for privacy is defined as the availability of carrels 
or positioning of some desks or small tables so as to allow un- 
distracted study. Inadequate means no such spaces or room for 
only one or two. Adequate means provision for 3 to 5 persons to 
study in relative privacy from other classroom activities. Ex- 
cellent means provision for at least 25% of the class to engage 
in undisturbed study. 

Example //I . A classroom is large with few students and has small 
tables and chairs in various arrangements. An auxiliary media center, 
used by the class , contains s tudy carrels . Score 3 on all i terns . 

Example. #2. A classroom has desks with affixed seats, in rows, in a 
fairly crowded room. An auxiliary media center, used by the class, 
has two large tables with chairs all around them. Score 1 on all 
items. ILf-I-'i 
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ACCESS TO RESOURCES 

The intent is to document the availability of resources that the student 
may want to draw on to supplement his basic learning materials. 

. Audio ma terials are those materials which essentially depend on 
sound, whether recorded or transmitted. Tapes, records, radio, 
and Language Master audio cards fall in this category. 

• Visual materials are those materials which are essentially pictorial 
or graphic representations with educational value. Films, films trips 
or study prints fall in this category. 

• Suppleme ntary printed materials are defined as library-type materials 

Example //l . A classroom is "traditional" with little storage of 
materials in the room. With permission, children C° to a library 
containing only books. No media center exists and the principal 
keeps equipment in a supply room for issue to teachers. Score 1 on 
audio materials and visual materials. Score 2 on supplementary 
printed materials. 

Example #2. A classroom is a math classroom (at the junior high 
level) with a wide variety of printed and manipulative materials in 
it. Stludents also freely use a well stocked learning resources center 
with au^io, visual and book materials. Score 3 on audio and visual 
material^. Score 4 on supplementary printed materials. 

/ 

NOTE: Space is provided for remarks about the learning setting or the dynamic 
of the teaching-learning interaction which are not covered by the scored items 
on the documentation sheet. For instance, the comments may concern things ob- 
served which may help in completing the EDEXAG treatment description. 

Example: "Objectives of the day's study were read aloud to the 

children. Two teacher aides were present throughout." 

rri-i-4 
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DEGREE OF GROUPING 

The intent is to describe whether the class is studying in an individu 
alized, small group or large group mode or some combination of these, rela- 
tive to the subject matter. 

• Individualized is defined as studying singly or in "independent 11 
pairs. If everyone is studying the same assignment it should be 
classed as large group. Note that "the same assignment "refers to 
a task (reading a given chapter, etc.) and not to a topic (learn- 
ing vocabulary, etc.). 

Smal 1 group is defined as studying in a group of three to nine. 
Large £rou p is defined as studying in a group of ten or more. 

Example #1 , A class of 25, composed of one group of 12 children, 

two groups of four children, and five children studying independently. 

Mark answer 7. 

Example //2 , A class of 24, composed of three groups of 8 children. 
Mark answer 2. 

Example //3 . A class of 30, all are studying individually but during 
the 15-minute period all students form into a single group for further 
instruction. Mark answer 5. 
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FOCUS OF ACTIVITIES 

The intent is to describe whether the class is studying cognitive or 
affective material or both. If the school schedule calls for either .Language 
Arts or Mathematics to be taught but the class is not actually engaged in 
that activity, delay documentation until study begins. 

Cognitive material is defined as the acquisition of information 
or skills in Language Arts or Mathematics. 

Affective material is defined as^the development of positive 
attitudes toward self or others. 

Example //l . A class is solving arithmetic computation problems, 
nothing else is happening. Score 4 on cognitive and 1 on 
affective. 

Example //2 . A class is engaged in two activities. About half the 
class is working on vocabulary development. The other half of the 
class is studying social studies. No other activity is occurring. 
Score 3 on cognitive. Score 1 on affective. 

Example //3 . A class is engaged in two activities. About half of 
the group is reading a story. The story is designed to modify attitudej 
about ethnic groups. The other half of the class is studying fractions 
Score 3 on cognitive for Language Arts or Mathematics depending on 
which is being documented on that sheet. Score 3 on affective for 
Language Arts, but score 1 for affective on Mathematics. 
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USE OF MATERIALS 

The intent is to describe the variety In types of materials present or 
in use in. the classroom. Materials should be. readily visible (e.g., on 
shelves, open-access cabinets) in the classroom <or learning center. 

• Printed materials are those materials which are essentially 
verbal and in paper form. Texts, workbooks, programmed instruc- 
tion materials and SRA Reading kits fall in this category. 

. Visual materials - defined as before. 

• Audio materials - defined as before. 

• Manipulat ive materials are those objects which are essentially 
handled or examined directly. Models, specimens, and activity 
materials such as cuisenaire rods, educational games and- flash 
cards fall in this category . 

• Instructional guides are the special class of materials which 

di rect children to appropriate study materials for attainment of 
objectives. In general', these guides pertain to modules of in- 
struction and are used individually by children. Note that in- 
structional guides need not constantly be in use or be used by 
all students. The critical question is whether the children 
are doing what they are doing because an instructional guide 
prompted that activity. Teaching-learniru^ units, learning ac- 
tivity packages, contracts, continuous progress worksheets, and 
teacher-made modules fall in this category. 

Example //l. A cla^s is engaged in oral reading. Visible in the room 
are manipulative materials and filmstrips. Score 3 on printed materials, 
2 on visual materials, 1 on audio materials, 2 on manipulative 
^materials, and 1 on ins t-ruc t ional guides. 

Example 112 . A class is using teaching- learning units in an individualized 

mode. Some children are reading, some working with flash cards. In a 

nearby media center, some are listening to tapes and some are viewing an 

8mm film. Score 3 on all categories. 

Note: The documenter may have to move to another location to see 
what various class members are doing. 

rii-i-7 
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APPENDIX IV-A 

An Investigation of Longitudinal Changes in 
Innovative School Programs 
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APPENDIX IV-A 
An Investigation of Longitudinal Changes in 
Innovative School Programs ' 

Rationale 

4 

One of the most intriguing, but largely unexplored, areas of educa- 
tional research is the phenomenon of change in school programs over time. 
A-major unanswered question is the extent to which change, when it does 
occur, is stable — i.e., has a lasting effect on instructional strategies 
and approaches from one year to the next. More specifically, what is 
the long-range effect when a school system adopts an innovative pro- 
gram or practice? Does this lead to more innovation throughout the sys- 
tem? Is "innovativeness" sustained, or is there an eventual regression 
to the more traditional approaches once the new idea has been tried out? 

During the four years in which interview and observation data were 
collected from the various school districts represented in Project LONG- 
STEP, site visitors shared a general impression that many of the districts 
were becoming slightly more traditional'in . their educational treatments. ' 
At several locations there appeared to be less use being made each year 
of such innovative practices as individualized materials, interdiscipli- 
nary and team teaching, and emphasis on the affective domain in the 
instructional program. There was a growing feeling on the part of Staff 
members that innovation might be a cyclical process; since districts had 
been selected largely on the basis of reported innovative programs, perhaps 
selection" had occurred at the peak of this cycle or curve, and site 
visiting was occurring during the downward slope of the curve., with a . 
gradual shift from innovation back to tradition. In short, there 
appeared to be a ''regression to the mean 1 ' across school programs. . 

•If this phenomenon did exist, it would have major implications for 

those who design and implement new programs in the schools. It would be ■ 

of importance also to know whether or not programs remain relatively 

stcible over time, and whether this stability exists at all grade levels 

and across program elements. j 

4 
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It was decided that answers to some of * these questions might be 
found by a more rigorous examination of the empirical data collected for 
Project LONGSTEP over a four-year period**. This appendix describes the 
results of that analysis. 

Procedures 

The central focus of the analysis was the extent to which educational 
practices undergo change or remain stable over time. The elements of 
analysis were therefore selected scales from the Educational Experience 
Analysis Guides which described treatment group characteristics at each 
'site for the four school years from 1970-71 , through 1973-74. The scales 
of interest were those considered to be the primary measures of innovation 
obtained in Project LONGSTEP in the subject areas of language arts and 
math. A list of the scales, the items comprising each scale and the scores 
for item alternatives are included in Attachment 1 following this appendix. 
A complete discussion of scale' construction and analysis procedures and 
the coefficient alphas for the multi-item scales are contained in Chaptey^~ 
III of the report. ' „ [ 

Sca'le items we're scored in £he direction of greater innovat ivoness .[ 
For those scales consisting of dichotomous items from the EdExAG, a "Yes- 1 
response earned a score of "3**' on each item, while a "No" response earned 
a sifbre of "1." Scores on all of the items in the scale were then averaged 
to obtain the scale score. For those, scales containing multi-choice items, 
a score of "1," "2, "* or "3" was assigned to each choice, reflecting a 
range from traditional to innovative with "2" as a midpoint. Here, too, 
item scores were' averaged to obtain scale scores. 

~ Not all of the schools and grades which participated in Project 
LONGSTEP were included in this analysis sample. Because the study was not 
Cross-sectional but rather had been designed to follow students as they 
progressed from one grade to the next, there were some schools and grades 
where data had not been collected for more than one or two years. The 
sample for the stability analysis consisted only of those grades and 
schools in which data had been collected for three consecutive school years. 



IV-A-2 



1 V.R 



Once these grades and schools had been defined, they wore visited for an 
additional year for purposes of program documentation . 

Two other characteristics of the data should he noted. Tin- has it- 
unit of analysis was the EdExAG group, defined as all the students in a 
school who were receiving the same educational treatment in a particular 
year. In some cases, an EdExAG group consisted only ofxstudents in one 
classroom; in other instances an EdExAG group included aPd students at 
one grade level or all students enrolled in language arts or math in one 
school. Consequently, there was wide variation in the number of students 
represented by one EdExAG group as compared with another. No weighting 
procedure was performed to adjust for this variation. EdExAG scores 
were considered equal, regardless of the number of students included in 
the educational treatment. There was a similar variation in the number 
of EdExAG groups at the different grade levels, largely as a result (if 
the student tracking procedure mentioned earlier". Tables 1 and 2 show 
the number of EdExAG groups by grade and by year that were included in 
the analysis. (All of the tables used in the analysis are included in 
Attachment 2 at the end of this appendix.) As can be sjen there were 
relatively few student groups at the ninth and tenth grade levels for 
all four years of the study. In the discussion that follows, therefore, 
greater confidence can be placed in the results from the lower grades 
because of the larger number of treatment groups involved. 

Four data sets were used in the analysis, consisting of 

(1) the mean scores on eac scale for a": 1 math EdExAG groups at each 
grade level for all schools combined; 

(2) the mean scores on each scale for all language arts EdExAG groups 
at each grade level for all schools combined; 

(3) the mean scores on each scale for all math EdExAG groups at an 
individual school, across all grades; 

(4) the mean scores on each scale for all language arts EdExAG groups 
at an individual school, across all grades. 

Three separate analyses were performed. The purpose of the first 
was to dt. Tinine whether schools in general were becoming more innov^ive 
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or more traditional in certain aspects of their programs. The purpose 
of the second was to look for any significant shifts toward more innova- 
tive or more traditional practices within grade levels for all schools 
combined. Finally, the scale scores from a small number of "high change 1 ' 
schools were analyzed to determine if changes at individual -schools were 
in a consistent direct ion-- i • e • , toward innovation or toward traditional 
approaches across time. « 

Two criteria were used for defining a "significant program change." 
For the f our scales cons is t in g of on ly one it em f rom the que s t ionna ires , 
the dif r erence between the mean score i.n Year 1 and mean score La Year 4 
had to be .5 or greater. This would indicate that at Least half of the 
KdKxACi groups had changed by one scale score or more. For those scales 
' consisting of i.mitiple questionnaire items, the difference in mean scores 
had to be .3 or greater, approximating a similar shift in mean .scores for 
half of the groups. Possible scores ranged from 1.0 to 3.0, with the 
higher score representing a more innovative approach. Although scores 
for all four years of data collection were available, comparisons were 
made only between the first year and the last as a means of assessing* 
long-term trends and also to reduce the complexity of the analysis. 
Exceptions were the scales relating to Completeness of Instructional 
Package and Utilization of Student Evaluation, where scores were deleted 
for Year 1 because of i ncomparab i 1 i t y of the component items. For these 
two scales, comparisons were made between Year 2 and Year 4. 

Find ings 

Trends in D ime n s i o n s of I n n ov a t i on 

* U t i 1 i _z^i_ti on_ oj: 0 bjec t i ves . F o r s c h o o 1 s in this analysis, one of 
the most widespread and cons i stent ly used innovat ions across grades and 
time was the use and evaluation of behavioral objectives, in both language 
arts and math. A scale score of 2.0 or higher indicated more "Vt"" than 
"No" answers to questions about: the existence of written objc-*! ' for 
the treatment group, whether these objectives were stated in he: vioraL 
terms, and whether eval native procedures -were used to confirm the attainment 
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of objectives.' During the first year of the study, it was onlv in fifth 
and tenth grade math that mean scores were at or beJow 2.0, and in both 
instances there was an increas*^ in t'he use of objectives by Year . The 
only significant decrease in thl: use of objectives across tiie four- years 
occurred in the ninth grade for ^anguage arts (from 2,8 to L.'J). other- 
wise, scores were relatively stably and high (2.5 or bettor) for all grade 
levels and all schools combined. (See Tables 3 and 4.) 

2 . Ind i vid ua 1 iz at ion _i_n_ Decision Mak_i_ng . Overal 1 , the student s in 
this analysis appear to have had relatively little choice in deciding the 
topics, materials, and sequencing of instruction for either Language arts 
or math. With one exception, mean scores were low for all grades during 
both Year 1 and Year 4 (less than 1.5), indicating a tendency for such 
decisions to be made by the teacher only or to be dictated by the mate- 
rials or curriculum. In on i v one case (ninth grade Language arts during, 
Year 1) was the mean score greater than L.5, and there was a decrease in 
this score by Year 4. Otherwise, tiiere was Little or no change across 
grades over .time. (See Tables 5 and 6.) 

^* l£^5j?g£.J?£_j^ a -U-y- Developed Materials. At most g-:de levels, 
the* schools in this analysis tended to depend on externally developed 
materials for their math and language arts programs. however, scores for 
the seventh and eighth grades, in each of the four years, indicated a 
slightly greater use of teacher or locally developed instructional mate- 
rials at the junior high level. Over time, it is possible to discern a 
slight and consistent trend toward local materials'in math between Years 1 
and 4, especially for grades 2, 3, 4, 7 and 9. In language arts, the 
largest change was toward local materials in grade 9*. (See Tables 7 and 
8.) 

^* Individualization of In structi o nal Pace. For this one- item scale, 
a score of 1.0 meant that group pacing was the norm for classroom instruc- 
tion, while a score of 3.0 meant that students were allowed to ■. ermine 
their own individual rate of progress. Mean scores for both language arts 
and math for most grades and in every year were at or near 2.0, indicating 
that among the schools in this sample there was general use of both group 
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and individual pacing within treatment groups. Scores tended to be slight I 
Lower for grades 9 and 10 in language, arts. There were no significant 
changes in this pattern over time in either language arts or math. (See 
Tables 9 and 10.) 

5 . Sch e dul ing Cluirax: t e r i_s t ic s . For grades 2 t h r o ugh 8 , the mean 

scores on this scale show a tendency toward urac i t ionnl class periods with. 

some variation for both language .arts and math. Scheduling for grades 9 

and 10 was more often characterized as traditional class periods only. 

The only notable change occurred in language arts for grade 8 where the 

shift was lway from flexibility toward a fixed schedule (-from 2.0 to 1.5). 

However, over time for nearly all grade levels in both subjects, it is 

possible to see a slight trend toward traditional schedules. (See Tables 

t 

11 and 12.) 

6 . Use ot Pe r for mane e Agree ments . The use of performance agreements, 
an assumed characteristic of many individualized instructional programs, 
did not appear to be a widespread practice in these groups for either 
language arts or math. Most mean scores fell between 2.0 (used for some 
areas in the treatment) and 1.0 (not used at all). Moreover, nearly all 
major changes over time were downward, especially in grades 2, 3 and 10. 
(See Tables 13 and 14.) 

Classroom Group Organiz ation . By and large, classroom grouping 
patterns were more likely to be flexible than fixed, with slightly higher 
flexibility in grades 2, 3 and 4 for both language arts and math. Scores 
generally indicated the use of fixed groups with some flexible grouping 
at some times. Mean scores were relatively stable' over time for both 
language arts and math, with the onLy large decrease in grade 8 for 
language arts, and the only large, increase in grade 10 for math. (See 
Tables. 15 and 16.) 

8. T eac hing Unit Composition . This ale measures the extent to 
which a teacher is instructing alone in tin* classroom, has paid or volun- 
teer helpers, or is part of a team teaching situation. Generally^" the 
picture over all grades and years is one of a teacher working with the 
help of aides. There is a slight tendency toward team teaching during 
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Year 1 only, in grades 2 and 3, and toward cl. eachor as sole i nst nu:for 
in grade 10 for both Year 1 and Year 4. The pattern is similar for both 
language arts and math. Major changes ovc i Ire are all in a downward 
direction, which may be indicative of a loss of funds as much as a shift 
toward a more traditional setting. These changes occurred in grades 2, 3, 
4, 9 and 10 for math; a- ides 2 and 5 for language arts. (See Tables 

17 and 18.) 

u . C.omp 1 et eness of Ins t rue t i onal Package ■ Items in this scale were 
developed on the theory that innovative school programs are more apt f. o 
utilize special instructional packages or materials and are less likely t<< 
r 1 on textbooks than are traditional programs. Generally, the moan 
scares indicate that both textbooks and special materials were used within 
all treatment groups for both language arts and math, with little variation 
■icross grades or time. The only exception is a slight decrease in the use 
of special materials in tenth grade language arts. (See Tables 1 9 and 20.) 

JU. Utilization o f_ Student j^i^J^J 1 IPJ± • ^ major character ist ic of 
indiv: iuili/ed, although not necessarily innovative, programs is the use 
i>r ev.ilualive procedures to assess the progress of individual students 
rather than the class as*a whole, as well as to modify the cducat ionai 
treatment based on this evaluation. At nearly every grade level, for 
beih language arts and math, scores on this scale were relatively high and 
stable. A notable exception is grade 9, where there was an obvious frond 
teward traditional aeh i evement measurement in language arts, and scores 
were i - >mparat ive 1 y low though stable in math. There was a similar shift 
teward traditional assessment in tenth grade language arts, although stu- 
dent evaluation remained at a high and con: istent level in math. (See 
Tables 21 and 22.) 

Trend:; within tirade i-yels 

I'm i" this ana \ y s i s , data we re . examined on 1 y for grades j , r ) , 7 , 9 and 
10, providing two grades at the elementary school level, two at the 
junior high school 1 eve 1 , and one grade at the high school level. It was 
leLt that these data would be sufficient to show any inter-grade differ- 
ences in trends ever time, without being redundant (i.e., grades '3 and 4 
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in any given school were likely to have very similar instructional 
programs) . 

Grade 3 . Taking 2.0 as a midpoint between a" highly traditional (.1.0) 
and highly innovative (3.0) program, mean scores for grade 3 on the ten 
scales of interest were about evenly divided between traditional and inno- 
vative tendencies across time for both language arts and math. Kxce.pt 
tor an increase in the use of teacher developed materials for math, other 
changes between Years 1 and 4 were mostly in a downward direction. Tn 
math, there was less use of performance agreements and fewer adults in 
the classroom. In language arts, also, there were fewer adults in the 
teaching unit. (See Tables 23 and 24.) 

Grad e 5. Mean scores for grade 5 in both language arts and math 
generally tended toward the traditional end of the scale except for the 
use of objectives and the use of student evaluation, both of which received 
scores leaning toward the innovative. For both subjects, scores were 
extremely stable across t^ie four years. The only major changes in any 
direction were an upward trend in the use of objectives and student evalu- 
ation for math. (See Tables 25 and 26.) 

Gra de 7. Overall, mean scores for grade 7 tended to be at a midpoint 
on the innovative continuum, except for an unusually high use of objectives 
and relatively low use of individualization in decision making and flexible 
scheduling. Thu only changes over time worth noting occurred in math, 
where there was an increase in the use of teacher or locally developed 
materials, and the use of performance agreements. (See Tables 27 and 28.) 

Grade _9. Mean scores for grade 9 tended to be low on all of the 
scales, except use of objectives which was high for both language arts 
and math during most years. However, there was a sharp drop by Year 4 
in the use of objectives for language arts. Other decreases occurred in 
the use of student evaluation and individualization in decision making 
for language arts, and in the size of the teaching unit for math. The 
only no table increase was in the use of locaLly or teacher developed 
materia Ls for both subjects. Overall, pr ^»g ram components at the ninth 
grade level tended toward the traditional. (See Tables 29 and 50.) 
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Grade 10. Mean scores remained at a relatively low level over time 
in both language arts and math. One^ exception was the use of objectives, 
which by Year 4 had shown an increase to a relatively high level in both 
subjects. There was an increase also in the flexibility of classroom 
grouping for math, although scores for both Year 1 and Year 4 tended 
toward the traditional (from 1.3 to 1.8). For math, decreases occurred 
over time in the use of performance agreements and in the size of the 
teaching unit composition. For language arts, there were decreases in 
the use of special instructional materials and in the use of student: evalu- 
ation. (See Tables 31 and 32.) 

Tr_en^ds w^thjLn tgh_ CJk: . " j^choo Is 

The analysis of changes ana trends. b: innovative scales and by 
grade levels, was based on scores for a.^ ochools combined. It was recog- 
nized that such combined scores would tend to obscure the variation occur- 
ring in individual schools. Therefore, a third analysis was conducted to 
determine if i_here were discernible trends toward more innovative or more 
traditional approaches in certain "high change" schools. 

For this analysis, scores were examined for each of the 14 schools 
in the study, and tallies were made of any significant changes that had 
occurred between any of the four years. The criteria for significant 
change were the same as those used in the earlier analyses— i . e . , .5 on 
one-item scales, and .3 on multi-item scales. Schools were then arranged 
by rank order, and the top ten were selected in terms of the number of 
changes occurring over scales and over time. It was felt that no more 
than two schools per district should be included in the analysis, for a 
more representative sample. Four of the top ten schools were eliminated 
on the basis of this criterion, and the final group therefore included 
schools among the top 14 in terms of change, representing six districts. 
The analysis was limited to grades 3, 5, 7 and 9, and this in turn meant 
that each school was represented by only one or two grade levels. Figures 
1 and 2 show the direction of the changes that occurred between Year 1 and 
Year 4 in the ten selected schools. (Comparisons are between Years 2 and 4 
for Completeness of Instructional Package and Utilization of Student: 
Evaluation, for reasons explained earlier.) 
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Name of Scale 



Utilization of Objectives 

Individualization in Decision 
Making 

Teacher or Local Ly Developed 
Materials 

Individualization of 
Instructional Pace 

Scheduling Characteristics 

Use of Performance Agreements 

Classroom Group Organization 

Teaching Unit Composition 

Completeness of Instructional 
Package 

Utilisation of Student Evaluation 

L 



+ 
+ 
+ 



School 
4 " 5 



0 0 



0 0 



O O O Li 



10 



+ significant increase 
- significant decrease 
v no change 
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Name of Scale 


1 


2 


School 

.345 


6 


1 


8 


9 


10 


Utilization of Objectives 


0 


+ 


■* - n 

U 






0 


0 




Individualization in Decision 
Making 


0 


0 


+ 




0 








Teacher or Locally Developed 
Materials 


0 


+ 


o o 


0 


+ 


+ 


0 


o 


Individualization of 
Instructional Pace 


+ 


+ 


0 


0 


— 


0 


0 


0 


Scheduling Characteristics 


0 


0 


0 


+ 


+ 


- 


- 


■■ 


Use of Performance Agreements 


+ 


— 


- 


- 


- 


0 


0 


- 


Classroom Group Organization 


+ 


+ 


0 


0 


- 


0 


0 


0 


Teaching Unit Composition 


+ 




0 


A 

u 










Completeness of Instructional 
Package 


+ 


0 


0 


0 


0 


0 


+ 


0 


Utilization of Student Evaluation 

L.. 


+ 




0 0 








0 





+ significant increase 
- significant decrease 
o no change 



Figure 2. Trends over time in innovative practices 
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, Only one of the ten schools exhibited a consistent and markeX Lruiul 
toward innovation over the four years of the study. By the end of\r^ar A, 
this school had the highest possible scores (3.0) on seven of the ten 
scales for both language- arts and math, with a score of 2.5 'on one other 
scale. Paradoxically, tor the two remaining scales (Individualization < 
Ln Decision Making and Teacher or Locally Developed Materials),, scores were 
relatively stable and low over time. 

One of the schools appeared to be in a state of flux, with an almost 
even number of changes toward innovation and toward the traditional. 
Generally, however, scores tended to be low during both Year 1 ami Year 4 
and for both language arts and math in this school. 

For aLl of th. ther eight schools, the number of changes in the ^ 
traditional direction far outnumbered changes toward innovation in both 
language arts and math, indicating a clear trend toward traditional edu- 
cational approaches and confirming the hypothesis on which the analysis 
was based. In one of these eight schools, the trend was downward on all 
ten scales of innovation for math. 

The sharpest declines occurred across schoo Is in the use of perfor- 
mance agreements and the size of the teaching unit, in both language arts 
and math. Seven of the ten schools had decreasing scores on these scales. 
S i >: of the ten schools showed a decreasing use of individualization in 
decision making and the use of ■tucieiit evaluation. At five of the ten 
schools, there was less use ol or- j eci: \ ves and less flexibility in class 
scheduling* The only S'.:aK-s ^hi.l" rvnained relatively stable over time 
for all of the school • w.m Teach*' r or Locally Developed Materials, 
Individualization of Ins'r t/ iu.i' Pace, Flexibility of Classroom Group- 
ing, and the Use of Special Instructional Materials. 

Cone 1 u siijiis 

■Th-o findings from. all three analyses generally indicated that, even 
among relatively innovative schools, there were traditional approaches in 
many aspects of the educational, program. This was true for both language 
arts and math instruction, and for al 1 grade levels. It was also I nu- 
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that within schools, within grades, and within ' program components there 
were many fluctuations from year to year in an orientation toward the . 
traditional or the innovative; and only rarely was there a consistent pat- 
tern to these changes within an individual school. Over time, however, 
there was a discernible trend toward more traditional instruction across 
most of the schools, and grades studied;, and this trend was even more pro- 
nounced in those schools exhibiting the most changes. > 

These analyses documented with empirical data the existence of a 
"regression to che mean" phenomenon in a group of innovative school pro- 
grams. What tluj data do not reveal is why this phenomenon occurs, and 
"it is interesting to speculate on possible causes, such as: 

• reduced federal and state funding over time for special 
programs, and the inability of local districts to continue 
support for expensive programs; 

• insufficient attention to the process 'of change, and a 
general lack of planning for the facilitation of such change; 

• unrealistic expectations for the outcomes of innovative 
programs, and subsequent disenchantment with the effects 
they produce; 

9 lack of commitment at the school leye L to new programs and 
to the integration of innovations into the total educational 
program; * 

• the natural inertia of any organization to change; 

• a perceived lack of effectiveness of innovative approaches, 
as compared with the familiar traditional practices. 

It was not the purpose of this investigation to look for reasons for 
this regression. However, it would appear to have important implications 
for those who plan or implement new educational approaches. Innovative 
changes do not sustain themselves over time; if it Js the intent of school 
administrators to move their programs in an innovative direction, then 
some attention uiust be paid to this drift hack toward the traditional and 
ways must be found to maintain the innovative thrust of the educational 
approach . 
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Scale Name 

Utilization of Objec- 
t Ives 



Individualization in 
Decision Making 



Attachment 1 








Scale 1 terns 


Alternative 


Scores 


Are there written 


n 

J - 


Yes 




oh j octives? 


1 - 


No 




Objective's in behav- 


3 - 


Yes 




loral terms 


1 - 


No 


V 


Evaluation used to 


3 - 






COt'l firm oh i P p t" i c; 




No . 




Topic selection" " 


3 - 


Student 


only 




2 - 


Student 


and 




**> 


t e a ch e r 






1 - 


Teacher 


only ' 




1 - 


Treatment dic- 






tates topic 




* 


selec tion 


Mate rials /text selec- 


3 - 


Student 


only 


tion 


2 - 


Student 


and 






teacher 






1 - 


Teacher 


only 



1 - Treatment dictates 
materials/ text: 
selection^ 



Sequencing decisions 



Teacher or Locally 
! )(?. ve 1 o p e d Ma t e r i. a 1 s 



individualization of 
Iiim ructional Pace 



Externally developed* 
materials 



Dependence on locally 
developed material s 



Instructional pace 
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Student only 
Student and 
teacher 
Teacher only 
Treatment dic- 
tates sequencing 

Little or none 
Some 

Almost exclu- 
sively 

Complete depen- 
dence 

Some dependence 
No dependence 

Individual deter- 
mines own rate 
Individual and 
group pacing 
Group pacing 
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Scale Name 



Scale Items 



Alternative Scores 



Scheduling Character- 
istics 



Scheduling 



Use of Performance 
Agreements 



Classroom Group 
Organizat ion 



Performance agree- 
ments 



Classroom organiza- 
t ion 



? _ 



1 - 



3 - 



1 - 



Flexible schedul- 
ing 

Traditional class 
period' with some 
variat ion 
Traditional class 
periods 

Ls a major ingre- 
dient of the 
t reatment 
Used for some 
areas in the 
treatment 
Not used at all 

Flexible groupings 
Fixed group with 
some flexible 
groupings at some 
times. 

Traditional fixed 
group organization 



Teaching Unit Composi- 
tion 



Teaching team size 



Classroom use 'of 
adult aides 



3 - Team teaching in 

a classroom 
2 - One teacher with 

paid aides per 

classroom 

2 - One teacher with 

volunteer aides per 
classroom 

1 - One teacher per 

c lassroom 

3 - Instructional 

2 - Tutorial 
2 - Other 

1 - Clerical or super- 

v is ion 
1 - Not used 
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Scale Name 



Scale L terns 



A.l t e rna t i ve S co re s 



C^tnpleteness of Instruc- 
tional Packaged- 



Utilization of Student 
Evaluation ' 



Special instruc- 
tional materials 



Use of textbooks 



Classroom use o i 
tests 



Test s used for 
evaluating studen t 
needs 

Eva iua t ion used to 
modi fy student 1 s 
t reatment 



3 Package provided 
entire "subject 
matter instruction 

2 - Regular materials 
"supplement special 
materials 

2 - Package is a supple- 
ment to regular sub- 
ject matter instruc- 
t ion 

1 - No special instruc- 
tional package pro- 
vided 



3 - 

3 - 

2 - 

1 - 



Textbooks are not 
used 

Other materials used 
but supplemented by 
textbooks 

Textbooks are used 
but supplemented by 
additional material 
Textbooks are used 
as the complete 
source with no addi- 
tional ma t e r i a 1 s 

Achievement sequencing, 
pacing and revision of 
mate rials 

Achievement sequencing 
and pacing 

Achievement measurement 
only with no effect on 
treatment 



3 - Yes 
1 - No 

3 - Yes 
1 - No 



"Not all i 
two seal l\ 



; were ask, 1 on 19 70-71 KdExACI ; therefore Year 
n;,V; - "''t he a included in this analvsis. 



or the 
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Atta ch ment 2 
TABLE 1 

Number of Language Arts EdExAC Groups 
Involved in Program Change Analyses 



Grade , 



2 


14 


16 


14 


13 


3 


14 


16 


18 


14 


4 


15 


19 


18 


15 


5 


30 


33 


3 3 


33 


6 


1 5 


14 


19 


21 


7 


8 


J 1 


15 


15 


8 


6 


8 


11 


1 1 


9 


4 


5 


5 


5 


10 


3 


6 


5 


5 



TABLE 2 

Number of Math Ed Ex AG Groups 
Involved in Program Change Analyses 



Irade 


1 


Year 

2 


3 


4_ 


2 


14 


16 


14 


13 


3 


14 


16 


17 


15 


■4 


14 


19 


10 


16 


5 


30 


33 


34 


3] 


6 


15 


14 


20 


21 


7 


9 


10 


16 


14 


8 


6 


8 


15 


1-5 


9 


4 


5 


5 


5 


10 


3 


5 


5 


4 
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* TABLE 3 



Mean Scores by Grade for 
Utilization of Objectives - Language Art-, 



I I _2 3 



1 


2 


.6 


2.7 




.6 


2 


.6 


] 


i 


. b 


2.7 




. 3 


2, 


.6 


4 


0 


.5 


2.1 


2 


. 3 


2 , 


.6 


5 


0 


2 


2.1 


2. 


. 3 


9 ( 


.4 


6 


2 . 


. 7 


2.5 


2 


. 7 


o _ 


, h 


7 


2 . 


.8 


2 . 2 


2 


.6 


2. 


.6 


8 


0 


8 


2.5 


0 


.8 


2. 


. 7 


9 


0 


.8 


2.5 


2 


.5 


1. 


.9 


10 


2 


3 


2.8 


2 , 


.9 


2. 


. 7 



TABLE 



Mean Scores by Grade for 
Utilization of Objectives - Math 



tear ' 

1 , 2 3 ' 4 



1 


^ . 


. 6 


9 


. 7 


2.6 


7 


.6 


3 


2 


. 6 


•) 


7 


2.3 


2. 


.6 




■> 


. 5 


•) 


. y 


2.3 




.6 


5 


■) 


.0 




. 1 


2.3 


2 , 


.4 


h 


2 


.5 


*) 


. 5 


2.9 


o 


7 


i 


-» 


, 7 




. 3 


2.8 




, 7 




2 


.7 


2 


.6 


2.9 




7 




o 


5 




. 3 


2.7 


> 


3 


10 


1. 


7 


'■> 


6 


2.6 ' 


2. 


5 
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TABLE 5 



Mean Scores by Grade for 
Individualization in Decision Making - I 



Arts 



Grade 


1 


Year 


3 




4 


2 


1.5 


1.4 


1.5 


1. 3 


3. 


1.5 


1.4 


1.5 


1.4 


4 


1.4 


1.5 


1.5 


1. 3 


. 5 


1.4 


1.2' 


1.4 


1.2 


6 


1.5 


1.3 


1.5 


1.3 


7 


1.5 


. 1-3 


1.4' 


1.4 


8 


1.4 


1.4- 


1.4 


1.4 


9 


.1.6 


1.2 


1.3 


1. 3 


10 


1.3 


1.7 


1.4 


1. 5 








TABLE 6 








Mean 


Scores by Grade 


for 




Individualize 


:ion in Decision 


Making - 


Math ■ , 




Grade 


1 


Year 

2 1 , . 


3 


4 


2 


1.5 


1.4 


1.5 


1. 3 


3 


1.5 


1.4 


1.5 


1.3 


4 


1.5 


1.4 


1.5 


1. 3 


5 


1.4 


1.3 


1.2 


1.2 


6 


1.5 


1.4 


1.3 


1.3 


7 • ■ 


i. : 


1.4 


1.2 


1.3 


8 


1.3 


1.1 


1.2 


1.2 


9 


1.4 


1.2 


1.3 ' 


1. ">. 


10 .. 


1.2 


1.5 


1.3 


1.3 
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i ABLE 



Hen Scores by Oracle for 
Teacher or Locally Developed Materials - ;,aiu*ua>;e Arts 













Oracle 


1 




Year 

3 






1 . s 


1.5 


1 . o 


1 .5 


3 


1.5 


1. j 


1.8 


i .6 


4 


'1.6 


1.7 


1.8 


1.6 


5 


1.7 


1. 7 


1.8 


1 .7 


b 


1.8 


] .8 


1.9 


1.9 


7 


2.1 


2.2 


2. 3 


2. 3 


8 


2 . 2 


2.4 


2 . 2 


2 . 2 


9 


1 .9 


2 . (1 


2.2 


2 . 0 


10 


1.7 


2.1 


2.1 


1 .9 



TABLE 8 

Mean Scores by Grade for 
Teacher or Locally Developed Materials - Math 





1 


.4 


1.4 


1 . 


. 7 


1 


. 7 


3 


1. 


.4 


1.4 


1. 


. 8 


L 


.9 


4 


1 . 


.5 


1.5 


1. 


. 8 


1 . 


.9 


5 


] . 


.8 


1.7 


1. 


. 8 


1. 


, 8 


ft 


1. 


,9 


1.8 


-1 . 


.9 


1 . 


,9 


7 


1 


. 9 


2. 1 


2 , 


■ J 


2 t 


, 3 


8 


2 . 


1 


2.0 


2 , 


,2 


-) 


2 


9 


1. 


, 8 


2.0 


2 ' t 


0 


2 . 


] 


10 


1. 


7 


1.8 


I. 


8 


- 1. 


8 
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TABLE 9 



Mean Scores by Grade for 
Individualization of Instructional Pace - Language Arts 



Grade 


1 


Year 

2 


3 


4 


■ 2 


2.1 


. t 


2.3 


2.0 


3 


2.1 




2.2 


2.1 


4 


2.1 


2.1 


2.2 


2.0 


5 


1.9 


1.9 


1.9 


1.9 


6 


2.2 


2.1 


2.2 


2.0 


7 


2.1 


2.1 


2.1 


2.0 


8 


2.2 


2.0 


2.2 


2.0 


, 9 


2.0 


1.6 


1.8 


1.6 


10 


1.7 


1.7 


1.6 


1.6 








TABLE 10 








Mean 


Scores by Grade 


for 




Individualization 


of instructional Pace 


- Math 




Grade 


1 


Year 

2 


3 


4 


2 


2.2 


2.3 


2.3 


2.1 


3 


2.2 


2.2 


2.2 


2.1 


4 


• 2.1 


2.2 


2.2 


2.0 


5 . 


1.8 


1.8 


1.9 


1.9 


6 


2.3 


2.2 


2.4 


2.2 


7 


2.0 


- 2.3 


2.4 


2.3 


8 


2.0 


1.9 


2.4 


2.3 


9 


1.8 


1.8 


2.2 


2.2 


10 


1.7 


2.2 


1.8 


1.8 
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TABLE 1 I 



Mean Scores by Grade for 
Scheduling Characteristics - Language Arts 



2 


1 


.9 


1.7 




1.8 ■ 


1 


7 


3 


1 


.9 


1.7 






1 


9 


U 


2 


.o" 


1.8 




1.8 


' 1 


7 


j 


1 


. 7 


1 .4 




1.6 


1 


5 


6 


1 


.9 


1.5 




1.8 


1 


6 


7 


1 


.9 


1.6 




1.7 


1. 


5 


8 


2 


.0 


1.8 " 




1.9' 


1 . 


5 


9 


1 


5 


1.2 




1.2 


1. 


2 


10 


1 


. 3 


1 . 7 




1.6 


1 . 





TABLE 



Mean Scores by Grade for 
Scheduling Characteristics - Math 



2 


1 


9 


1 


7 


1.8 


1 


6 


3 


1 


9 


1 


7 


1.8 


1 


8 


4 


2 


0 


I . 


8 


1.7 


1 


6 


5 


1 


. 7 


1 


4 


1.5 


1 


j 


6 


1 


3 


1 


4 


1.8 


1 


6 


7 


1 


7 


1. 


5 


1.6 


1 


5 


8 


1 


8 


1. 


6 


1.7 


1 


4 


9 


• 1 


5 


1. 


2 


1.2 


i 




10 


1 


3 


1. 


6 


1.6 


I. 


5 
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TABLE 13 



Mean Scores by Grade for 
Use of Performance Agreements - Language Arts 



G r a de 


1 


2 


Year 


3 


4 


2 


1 Q 


1. 6 




1.6 


1.5 


3 


1.9 


1.6 




,1.5 


1.5 




1.7 


1.6 




1.6 


1.5 


5 


1 7 


1 . 5 




1.6 


1.5 


6 


1 ft 


1 c 
1 . 0 




1 . 9 


1.8 


7 


' 1.8- 


1.5 




2.1 


2.1 


8 


1.8 


1.5 




2.0 


2.0 


9 


1.8 


1.6 




1.4 


1.4 


- 10 


2.0 


1-5 




I A 


1.6 






TABLE : 


L4 








Mean 


Scores by 


Gr,ade 


for 






of Performance Agreements - 


Math 


Grade 


1 


2 


Year 


3 


4 


9 


2.0 


1.6 




1.6 


1.5 


3 


2.0 


1.6 




1.5* 


1.5 


4 


1.8 


1.6 




1.6 


1.5 


5 


1.7 


1.6 




1 . ; 


1.6 


6 


1.9 


1.6 




2.2 


1..9- 


/ 7 


1.9 


2.1 




2.4 


2.4 


8 


1.8 


1.6 




2.3 . 


2.1 


9 


1.8 


1.6 




1.6... 


1.6 


10 


2.0 


. 1-4 


• 


1.2 


1.5 
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TABLE 15 



Mean Scores by Grade for 
Classroom Group Organization - Language Alls 



Grade 




1 


2 


Year 




3 


A 


2 




. 2 


o 


3 


2 


. A 


2.3 


> 3 


2 


. 2 


2 . 


3 


2 


. 3 


2. A 


A 


2 


.3 


2 . 


2 


2 


. A 


2.3 


5 


1 


.9 


1. 


8 


2 


. 1 


2.0 


6 


2 


. 3 


1. 


9 , 


0 


. 2 


2.0 


7 


2 


. 3 


2 . 


0 


2 


.0 


1.9 


8 




. 3 


2 


0 


1 


.8 


1.7 


9 


2 


.0 


r ; 


0 


1 


■ 8 


1.8 


10 


1 


.7 - 


0 


2 


2.0 


1.8 



TABU 7 . lfS 

Mean Scores by Grade for 
Classroom Group Organization, - Math 



Grade 



Year 

2 



2 


2.1 


2 . 


3 


2 . 


A 


2. 


3 


3 


2.1 


2 . 


2 


2 


A 


2 


A 


A 


2 . 1 


2 . 


2 


2 


A 


•2 


A 


5 


1.9 


1. 


9 


1 


9 


2 


1 


6 


2.1 


2 


0 


2 


0 




0 


7 


2.0 


2 


2 


2 


.1 


1 


9 


8 


2.0 


1 


8 


1 


.9 


1 


.8 


9 


1.8 


1 


8 








0 


10 


1.3 


2 


0 


2 


.0 


1 


.8 
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TABLE 17 

Mean Scores by Grade for 
Teaching Unit Composition -language Arts 

\ 



Grade 



Year 

2 



2 2.3 2.0 2.0 2.0 

3 2,3 2.0 1.8 1.9 

4 2.1 1.9 2.0 1.9 

5 1.7 1.8 1.6 1.7 

6 1.8 1.8 2.1 1.8 

7 * 1.9. 1.8 2.0 1.9 

8 ' 1.8 1.6 2.1 . 1.9 

9 1.6 1.6 1.8 1.6 
10 1.3 1.8 1.3 1,4 



r TABLE 15 



Mean Scores by Grade for 
Teaching Unit Co'i.y isition - Math 



Grade 


1 


2 


Year 

3 


4 . 


2 


2.3 


1.* 


2.0 


2 J 


3 


2.3 


1.9 


1.9 


1.8 


4 


2.1 


1.8 


2.0 


1.8 


. 5 


1.6 


1.8 


1.6 


1.6 


6 


1.8 


1.8 


2.1 


1.8 


7 


1.8 


2.2 


2.0 


1.9 


8 


1.8 


1.4 


1.9 


1.7 


9 


1.6 


1.6 


1.3 


' "A3 


10 


1.3 


1.5 


1.1 


, i.o 
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TABU'] 19 



Mean Scores by Oracle for 
Completeness of Instructional Package - Language Arts 



Grade 



Year 



2 2 . 1 2.0 2.1 

3 ' 2.1 1.9 2.1 

4 2.1 1.0 2.0 

5 „ 1.8 1.9 1.8 
b 1.9 2.1 2.0 
7 2.0 2.0 2.1 

'8 2.1" 2.0 2.1 

9 2.0 2.0 2.0 

10 2.2 2.1 1.9 



TABLE 20 

-Mean Scores by Grade for 
Completeness of Instructional Package - Math 



Grade- 




2 


2 


. 1 


2. 1 


2 


. 1 


\ 




.] 


1.9 




. 1 


'4 




. 1 


1.9 


2 


.0 


5 


I 


8 


2. fl 


1 


.9 


h 




0 


2 . 2 


2 


. 1 


1 


2 . 


A 


2 . 2 


2 




8 


2 . 


1 


2.2 


T 


3 


9 


\ 
l v 


9 


2.0 


2 


0 


10 


9 


\1 


2.1 


1 


9 
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TABLE 2 1 



Mean Scores by Grade for 
Utilization of Student Evaluation - Language Arts 



Grade 



Year 

2 



2 2.4 2.3 2.3 

3 2.4 2.3 2.3 

4 2.4 2.2 2.4 

5 2.3 2.5 2.5 

6 2.4 2.7 2.6 

7 2.3 2.4 2.3 

8 2.5 2.7 2.5 

9 2.1 2.2 1.5 
1° 2.3 2.5 1.9 



TABLE 22 

Mean Scores by Grade for 
Utilization of Student Evaluation - Math 



Grade 



Year 



2 2.3 2.3 2.3 

3 2.3 '2.3 2.3 

4 2.3 2.2 2.4 

5 2.3 2.5 2.6 

6 2.4 2.7 2.7 

7 2.4 2.4 2.'4 

8 2.3 . 2.6 2.4 

1.9 ■ 2.3 2.0 

10 2.5 2.5 2.4 

IV- A- 2 7 
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TAB Li- 



Mean Scores by S"a"*«o for 
Grade 3 - T.angn.j ; >o Arts 



Name of Scale 


Year 1 


Year 2 


Y e a r 3 


Year 4 


Utilization of Objectives 


2 h 


2.7 


2.3 


2.6 • 


Individualization in 
Decision Making 


j '\ 


1.4 


1-5 


1.4 


Te a ch p r or I nrnl 1 v 
Developed Materials 


1.5 


.1 . 5 


■ .1.8 


3.6- 


Individualization of 
Instructional Pace 


2.1 




2 . 2 


2.1 


Scheduling Characteristics 


1.9 


1.7 


1.8 ' 


1.9 


Use of Performance Agree- 
ment s 


1.9 


1.6 


1.5 


1.5 


Classroom Group Organiza- 
t ion 


2 . 2 


2.3 


2.3 


2.4 


Teaching Onit Composition 


2.3 


2.0 


'1.8 


1.-9 


Completeness of Instru't inna! 
Package 




2.1 


1.9 


2. L 


Utilization of Student 
Evaluation 




2 . 4 


2.3 


2.3 
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Mean Sco res by Scale for 
Grade 3 - Math 



— — — . . . 

Name of Scale Year 1 Year 2 Year 3 Year 4 



Utilization of Objectives 2.6 2.7 2.3 2.6 

1.5 1.4 1.5 1.3- 



Individualization in 
Decision Making 



Teacher or Locally 
Developed Materials 



1.4 1.4 1.8 1.9 



Individualization of 

• 2 2 9 9 9 9 1 

Instructional Pace ' z /,i 



Scheduling Characteristics 1.9 1.7 1 



Use of Performauce Agree- 
ments 

Classroom Group Organiza- 
tion 



1. 



2.0 1.6 1.5 1.5 



2.1 2.2 2.4 2.4 



Teaching Unit Composition 2.3 1.9 1.9 1.8 

Completeness of Instructional 

Package 2 ' 1 1 ■ 9 f 2.1 

Utilizat icnV of Student 
Evaluation 



157 
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. TABLE 

Mean Scores by Scale for 
Grade 5 - Language Arts 



Name of Scale Year 1 Year 2 Year 3 Year 4 



Teacher or Locally 
Developed Materials 



Individualization of 
Instruct ional Pace 



Use of Performance Agree 
ments 



Completeness of Instructional 
Package 



Utilization of Student 
Evaluat ion 



Utilization of Objectives 2.2 2.1 2.3 2.4 

Individualization in 

Decision Making 1.4 1.2 .1.4 1.2 



1.7 1.7 1.8 1.7 



1.9 , 1.9 1.9 1.9 

Scheduling-Characteristics 1^7 1.4 ■ 1.6 1.5 

1.7 1.5 .1.6 1.5 



j 

Classroom Group Oreaniza- 

tion l - 9 1-8 ' 2.1 2.0 

Teaching Unit Composition 1.7 1.8 1.6 1.7 

1.8 1.9 1.8 



2.3 2.5 , 2.5 



TV- A- in 
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TABLE 26 

Mean Scores by Scale for 
Grade 5 - Math 



Name of Scale 



Year 1 



Year 2 



Year 3 Yc 



Utilization of Objectives 

Individualizat ion in 
. Decision Making 

Teacher or Locally 
Developed Materials 

Individualization of 
Instructional Pace 

Scheduling Characteristics 

Use of Per f ormance Agree- 
ments 

? 

Classroom Group Organiza- 
tion 

Teaching Unit Composition 

Completeness of Instructional 
Package 

Utilization of Student 
Evaluation 



2.0 

1.4 

1.8 

1.8 
1.7 
1.7 

1.9 
1.6 



2.1 

1. 3 

1.7 

1.8 
.1.4 
1.6 

1.9 
1-8 
1.8 

2. 3 



2 . 3 
1,2 

1.8 

1.9 
1.5 
1.7 

1.9 
1.6 
2.(3 

2.5 



2.4 
1.2 

1.8 

1.9 
1.5 
1.6 

2.1 
1.6 
1.9 

2 . 6 



/ / 
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TARLE 



Me an S c o ro s by Seal e f o r 
Crade 7 Language Arts 



Name of Scale Year 1 Year 2 Year 3 Year 4 



Utilisation of- Objectives 2.8 2.2 2.6 2.6* 

1-3 L . 3 1.4 1.4 



Individualization in 
Decision Making 



Teacher or Locally 
De ve I oped Ma t e r i a .1 s 



2- J 2.2 2.3 2.3 



\ 

Individualization of 

Instructional Pace — 1 , 2 • 1 2.1 2.0 



Scheduling Characteristics 1.9 1.6 " 1.7 1.5 

1 • « 1.5 2.1 2.1 



Use of Performance Agree- 
ments 



Completeness of Inst rue' iona 1 
Pack a 



Classroom Group Organ iza- 

tion 2 - 3 - 2 -° 2.0 1.9 

Teaching Unit Composition I. 1 ) 1,8 2.0 1.9 

2-0 2.0 2.1 



Utilization of Student 

I- valuation 2 ' ] 2 - 4 



J 60 
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TABLE 28 

Mean Scores by Scale for 
Grade 7 - Math 



Name of Scale 



Year 1 



Year 2 Year 3 Year A 



Utilization of Objectives . 

Individualization in 
Decision Making 

Teacher or Locally 
Developed Materials 

Individualization of 
Instructional Pace 

Scheduling Characteristics 

Use of Per f ormance Agree- 
ments 

Cia^sroom Group Organiza- 
t ion 

Teaching Unit Composition 

Completeness of Instructional 

Package 

Utilization of Student 
Evalua t i on 



2.7 
1.3 

1.9 

2.0 
1.7 
1.9 

2.0 
1.8 



2.5 
1.4 

2.1 

2.3 
1.5 
2.1 

2.2 



2. A 



2 .A 



2.8 
1.2 

2.3 

2. A 
1.6 
2. A 

2.1 
2.0 



2.7 



1.3 



2.3 
1.5 

2. A 

1.9 

1J9 



2. A 



2. A 



I6{ 
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'.ABLE \'M 

Mean Scores by Scale for 
Grade 9 - Language Arts 



Name of Scale 



Year 1 Year 2 Year 3 Year U 



L't i 1 iza t i on o f Ob j e c t ive s 

Individualization in 
Derision Making 

['earner or Locally 
1 )e v e 1 ' v . ■ d Ma t e r ia 1 s 

1 ud i v i d ua 1 i ;:a t ion o f 
Instructional Pace 

Schedul ing Character i st ies 

Use of Performance A i; roe- 
mo n t s 

Classroom Croup Organ ir'.a- 
t ion 

Teaching Unit Composition 

Completeness of Instruct io* 
Package 

V l i 1 i z a t: i on o 1" S t udo n t 
F.valuat Lon 



2.8 



2.0 
l.o 
1.8 

2.0 
1 .» 



1 . 2 

2.0 

1 .6 
1.2 
1 .h 

2.0 

1 .r 
2.0 

2 . 1 



2.5 
1 . \ 



1.8 
1 .2 
1 .:. 

I .8 
1 .8 
2.0 



1 .9 
1 . j 



1 ..i 



: .8 



.0 



l . ) 




TABLE 30 
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Mean Scores by Scale for 
Grade 9 - Math 



Name of Scale Year 1 Year 2 Year 3 Year A 



Individualization in 
Decision Making 



Teacher or Locally 
Developed' Materials 



Use of Performance Agree- 
ments 

Classroom Group Organiza- 
tion 



Completeness oi Instructional 
Package 



Utilization of Objectives 2.5 2.3 2.7 2.3 

1.4 1.2 1.3 1.3 



2.0 2.0 2.1 



Individualization of 

Instructional Pace 8 1,8 2 - 2 2 - 2 



Scheduling Characteristics 1.5 1.2 1.2 1.2 

1.8 1.6 1.6 1.6 

1.8 1.8 2.2 2.0 

Teaching Unit Composition 1.6 1.6 1.3 1.3 

1-9 2.0 2.0 



Utilization of Student 

Evaluation 1,9 2 ' 3 2 -° 
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TABLE 31 



Mean Scores by Scale for 
Grade. 10 - Language Arts 





Name of Scale 


Year 1 


Year 2 


Year 3 


Year 4 • 


Utilization of Objectives 


2.3 


2.8 


2.9 


2.7 


Individualization in 
Pre is ion Making 


1.3 


1.7 


1.4 


1.5 


Teacher or Locally 
Developed Materials 


1.7 


2.1 


2.1 


1.9 


Individual izat ion of 
lnbLiuLLionai i ace 


1.7 


1.7 


1.6 


1.6 


Scheduling Characteristics 


1.3 


> 


1.6 


1.4 


Use of Performance Agree- 
ments 


2.0 


1.5 


V 

1.4 


1.6 


Classroom Group Organiza- 
tion 


1.7 


2.2 


2.0 


1.8 


Teaching Unit Composition 


1. 3 


1.8 


1.3 


1.4 


Completeness of Instructional 
Package 




2.2 


2.1 


1.9 


Utilization of Student 
Evaluation 




2.3 


2.5 


1.9 
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TABLE 32 



Mean Scores by Scale for 
Grade 10 - Math 



Name of Scale Year 1 Year 2 



Utilization of Objectives 1.7 2.6 

1.2 1.5 



Individualization in 
Decision Making 



Teacher or Locally 
Developed Materials 

Individualization of 
Instructional Pace 



1.7 1.8 



1.7 2.2 



Scheduling Characteristics 1.3 1,6 

2.0 1.4 

Classroom Group Organiza- 



Use of Performance Agree 
ments 



t ion 



1.3 2.0 



Teaching Urp.t Composition 1,3 1.5 

Completeness of Instructional 

Package * . ^ . 1 

Utilization of Student 

Evaluation ^.5 



1 6 :> 
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Approaches to. Individualization: 
Toward a Typology of Innovative Educational Pract 



Coles, (]. .1. Approaches to individualization: Tor :rd a tyr-logy r 
innovative educational practices. Paper ore en ted at cm 1975 
annual meeting of the American Educational Resenrrh as^k: in t ! nn 
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APPROACHES TO INDIVIDUALIZATION: 
TOWARD A TYPOLOGY OF INNOVATIVE EDUCATIONAL PRACTICES* 



Gary J. Coles 

American Institutes for Research 
Palo Alto, California 



The rwaic- : ipnrted hrr •.. •,. performed pursuant to a contract 
with O-fue of Educ-t on, U. S. Department of Health, Fdr- a- 

tion and tare (Conttaot .Number OEC-0-70-4789) . Contractor' 
undertaking such projects under Government sponsorship are encour- 
a.^d t~ express freely their professional judgment in the conduct 
ti -he project. Points of view or opinions stated do not, th, re- 
fore necessarily represent official Office of Education position 
or policy. 
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lucat ional Research Association, Washing .c n , D. C. 
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Approaches to Individualization: 
Toward a Typology of Innovative Educational Practices 

Gary J. Coles 
American Institutes for Research 

Introduction 

During the 1970-71 school year, the American Institutes for Research 
(AIR) began full implementation of a U. S. Office of Education (USOE) " . 
sponsored longitudinal study of intensive, innovative- education practices 
The purpose of this project was to examine over a three-year period she 
relative effectiveness of various educational experiences or treatments. 
IL was anticipated that these data would provide a valuable source of in- 
formation that could be used in designing new educational programs and -re- 
search efforts in the years ahead. This paper will discuss the general 
design and research goals of this study, the Longitudinal Study of Educa- 
tional Practices (Project LONGSTEP) and then review, the methodology used 

(1) to gather the s t udy 1 s ■ t rea tmen t data and (2) to create treatment type! 
representing the approaches to individualized instruction present in par- 
ticipating schools. 

Introduction to Project L ONGSTEP s 
The objective of Project LONGSTEP was to determine as comprehensively 
as possible over a three-year period (1) the relationships between selectt 
innovative education treatments and .student achievement and attitudes, an< 

(2) rnp components of these treatments which have had the greatest impact 

i 

on student outcomes. To re izo this goal, the general design of the stuc 
involved the collection of three major categories of data each school yeai 
H) educational treatmen t data, composed of variables which measure the ec 
rational environment of which the student is a member, including 
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(a) characteristics of the educational program(s) in which each student 
participates and (b) characteristics of each student's teacher(s) ; 
(2) ^udent characteristics (e.g., sex, socioeconomic status) brought by 
the student into his educational environment; and (3) s tudent outcome s, 
including both cognitive and attitudinal outcome variables. Student data 
were obtained from specially designed student questionnaires yielding back 
ground information and attitudinal outcome measures and from standardized 
achievement tests yielding cognitive outcome variables. Teacher data were 
obtained from a questionnaire completed by each teacher. Educational' 
treatments were documented by AIR staff via information gathered from 
interviews with principals and teachers, t rom classroom observations and 
from existing documentation of the treatment. Lastly, information iden- 
tifying each student's teachers (by subject) was obtained and used to 
relate specific treatment and teacher data to individual students. 

Since schools participated in Project LONCSTEP on a purely voluntary 
basis, it was not feasible to randomly assign students or student groups 
to treatment conditions; nor was it possible for AIR to systematically 
vary the treatments present in any given school. Rather, variation among 
the primary independent variables of the study was achieved through the 
selection of existing school programs. Thus, the schools invited to par- 
ticipate voluntarily in the .study were rimson because, c , a group, they 
represented, a range of innovative practices and because they also varied 
with aspect to other educational iv relevant characteristics (e.g., socio- 
economic level). Approximately 30,000 students, 1,500 teachers and 80 
schools in 11 school district* located throughout the United States even- 
tually participated in Project MWJSTEP during its three years of data 
collection (1970-71, 1971-72 and 1972-73). 
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Treatment Data Collection M ethodology 
Educational programs are composed of numerous related and unrelated 
processes or treatment components. For this reason, it was necessary to 
develop a system by which complex educational experiences present in the 
diverse sample of participating schools could be described and quantified 
with respect to specific observable educational characteristics. An Edu- 
cational Experience Analysis Guide (EdExAG) was developed for this purpose. 
This guide provided the conceptual scheme and the practical questions and 
alternative responses that AIR project- personnel could use in documenting 
the specific experiences of the students participating in the study. This 
guide, consisting of more than 80 items, was designed so that for each item 
it was possible to code the basic components or elements underlying a treat- 
ment on a continuum from "traditional" to "innovative." Quantitative mea- 
sures of educational "treatment" derived from this guide could then be 
associated with participating students, regardless of the schools which 
they attended. 

The data, collect ion unit for educational treatment data was a flexibly 
defined entity called an Educational Experience Analysis Guides group or 
EdExAG group. Different EdExAG groups were identified within a school 
when an AIR site visitor could differentiate among the treatments received 
by different groups of students at a school by means of items found on the 
EdExAG. Defined in this manner, EdExAG groups could include as few students 
as those within one teacher ^s class for one subject matter area or as many 
students as those in all grades within a school for all subject matter areas 
of instruction. EdExAG groups, then, were created in response to treatment 
va r ia t ions tha t exis ted within a school and within a grade and may he mo re 

or Less viewed as an efficient bat group-level approximation to the 

I \ - h~ '"» 
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documentation of each individual student's educational treatment. 

During the 1970-71 school year, this treatment documentation method- 
ology led to the identification of 141 such EdExAG groups, while 167 and 
228 wore isolated during 1971-72 and 1972-73 respectively. These 

groups, then, represented all of the different kinds of educational treat- 
ments that were provided hy the schools to which students participating in 
Project LONGSTEP were exposed during each year of the project. 

Measures of Educational Experi ences 
Prior to initiating analyses utilizing the EdExAG data, senior project 
staff who were familiar with the sites participating in the study and with 
educational program organization in general critically inspected each EdExAG 
item. Those items or combinations of items (i.e., tentative multi-item 
scales) were identified that would quantify what were judged to be the basic 
educational characteristics underlying the educational practices and pro- 
cedures included in the study. Item and scale analysis procedures were 
then undertaken so that the measurement properties of the FdExAG items and 
the tentative scales might be examined. 

The first step in the item/scale analyses of the EdExAG was to rank 
order the alternatives .or each of the items on an a priori scale from 
lesser to greater i nnova t iveness . Senior-level project staff then examined 
the intercorreia t ions among the items to confirm r.hat scale items were more 
highly related to other items in the same scale than to items measuring 
different construct?. Final scale content" was determined by considering 
these empirical re La t i onsi) i ps ana by reaffirming that the items were mea- 
suring, what wore judged to In- the same educational construct mi ,] priori 
grounds. Last, the internal consistency oi each multi-item .scale was ,-om- 

nuted to provide some estimate of the reliability* (if tht- measuremen 
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provided by each scale. Cronbach's (1.951) coefficient alpha (0 was used 
for this purpose. Coefficients for the multi-item scales ranged from .54 
to .82. 

The Concept of the Treatment Croup 

For purposes of collecting treatment information during site visits 
to participating schools, educatitmal treatments could not be defined in- 
dependently of the school at which the information was obtained. A site 
visitor, for example, could only document educational experiences oi the 
students in the participating school he or she was visiting, thereby iden- 
tifying what have been called KdExAG groups. The data gathered at. this 
stage, then, differentiated among groups of participating students wi thin 
the same school who were exposed to different educational practices. De- 
t ined in this limited manner, a treatment could include, at most, all the 
students in a single school, provided that ail these students had similar 
e due a t i o na 1 experiences. 

It was originaMy thought, however, that KdF.xAC groups def ined by 
this approach would not represent educationally unique configurations of 
practices. Some of the s J 1 , nonsvstoma t i c differences describing the 
F.dkxAG groups in each s< m .] o'lld be educationally trivial or represent 
inaccuracies in documentation. .'imilarlv, groups charact er i ;:ed by sup- 
posedly identical educational practices may not represent exactly the 
same treatment; due to the Lack of d isr v imi. nab i 1 i ty of the items on the 
KnHxAlI. 

Considerations such as these, mmpled witb. .) aviu-rvu thai the project 
.ina 1 .-ses should locus on ,:• limited number oi e dm a t i ona i I v mean Tnn : u 1 and 
ident i f iable student groups, suggested that students should be comb ined 
into larger analytic units based upon the similarity <»; their educational 
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experiences. Such a group was called a treatment group or treatment unit. 
Examination of achievement . attitude differences among such groups 
would then provide insights concerning the efficacy of the combinations 
of practices they involved. 

Clus ter Analysis Methodo logy 

Combining EdExAC groups into 1'rger analytic units representing dif- 
ierent "types" of educational approaches was accomplished by means of a 
cluster analysis procedure based upon Q-type tactor analysis. Separate 
analyses were conducted for the data collected each ..year 'and for language 
arts ( n = 92, 1971-72; n = 703, 1972-73) and mathematics (n - 89, 1971-72; 
n = 93, 1972-73) groups separately. 

Since the objectives of those analyses were to create a limited number 
of distinct but educationally meaningful treatment "types," it was first 
necessary to define the variable space within which combinations of EdExAC 

groups were to be identified. Although it would have been possible to quan- 

/ 

tifv differ-nees/sfmilar it ies among 1-dI-xAO groups with respect to all 25 
EdExAC. scales, it was decided that the clusters derived would be more inter- 
pretable and meaningful if the scales used represented measures of the same 
underlying educational construct. Furthermore, if these scales described 
what were considered to be major differences in educational approaches, the 
..lusters identified wouJ el represent a parsimonious number of types of treat- 
ments which w »re nk.:imnlly cifterent with respect to these key treatment 
components. For this reason, tne 10 EdExAC scales which Indexed some of 
the ma jo:" ways in which project schools were individual i:-im: instruction 
were selected to be tin- profile elements describing the approach of each 
EdExAC group. _ Tin wales were: Et i 1 ir.a r ion uf Objectives, Individual- 

ization in Decision Making, Teacher or locally Developed Materials, 
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Individualization of Instructional Pace, Scheduling Characteristics, Use 
of Performance^ Agreements, Classroom Croup Organization, Teaching Unit Com- 
position, Completeness of Instructional Package, And Utilization of Student 
i-valuation." These scales were chosen (1) because they represented ways in 
which sample schools were achieving some degree of individualization; 
(2) because one of the criteria used in selecting schools for participation 
in the project was individualization; and (3) because these scales documentor 
s^mo of the major process dimensions that, are of current interest in educatic 

Next, each of the I'dExAf. scale scores was transformed to a deviation 
sce-re by subtracting the scale mean (computed across all EdExAG groups in 
the analysis). A (>-typc average cross-products matrix was then compiled 
" o provide a multivariate measure of the similarity of each EdExAH group 
with every other group with respect, to the 10 individualization scales. 
Both Nunnally (1967 pp. 372-38S) and Overall and Klett (1972, pp. 180- 

have discussed uch vector-product measures of similarity and have 
noted that they are particular!-: useful indiee's since they can be sub]-. 'ted 
to rather "powerful" methods of anal'- .'is sue: i.s i actor avialysis. 



Each ;.)-typ:- average cross-prod 



at r 



i x wa s s lib j e c t od to a principal 



factors analysis in which each diuc.onai value was the average cross-pro- 
!uct of an entity 'i.e., EdExAi'. group, or profile with itself. Four fac- 
.ors were extracted in uch analysis and roMtcd to a varimnx criterion. 

n i s number or lac tors wa s spec i f i ed since- four fac : ors accounted for 71.1 
t more of the trace (sum of i }:•■ ata^ai; element s) of each matrix, and 
:ilK " ,> 1 rt'l.Uively P-irsirv a. ■ I ut i , >:1 wa y desired and since' the number 

■ ■-'.'ite,;or i-.-s created was cxpt . ted i.. be : w, fir,, ■ ; .. ».. n hor of factots. 

'*"''•' pur'pese.s n; !-c :;a:K: clusier m.-mhersaia, the-;c ■ :-t ype factors 
' , ' r '-' -"^'wed as "ideal types" »; treatments. i\d : :-:AC groans were assigned 
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to c iv of eight clusters on the basis of the roLaled factor on which each 
was loaded most highly (in terms of absolute value) and on the basis of 
the sign of that loading. 

In order to intei,^- t rho educational characteristics of the groups 
that were formed, th m.F • Sv.ale s ores in the original data matrix 
were converted to stand, a scores n:*d the mean and standard deviation ot 
: he EdExAG groups included in each cluster were computed. A. profile tor 
• ■ach cluster was plotted, each element being equal to the. mean standard 
seore for all EdExAG groups comprising the cluster. 

Disc ussio n of Cluster Resu lt s 

Project LONGSTKP staff who Wv.re familiar with t lie schools and EdExAG 
groups ^present in the study inspected the mean profiles which had been 
plotted. The most obvious trend in all of these mean profiles was the 
''act. that clusters defined as being positively and negatively related to 
t-he same "ideal treatment type" (i.e., bipolar O-type factor) tended to 

havi profiles which were mirror images of each other. Secondly, the 

P 

highest loading for about one-half of the EdExAG groups was on the first 
—type factor and for this reason, the largest cluster groups were those 
iefined bv that factor. Third, the treatment approaches defined bv the 
first factor were, for both school years, a generally "innovative" group 
and a fairly "traditional" group. Fourth, although there were some sim- 
ilarities of profiles across years, the combinations of approaches repre- 
sented bv the groups defined from the last three Q-type factors were very 
. nnph.v and,' in general, did not exist for two consecutive ' choo? years, 
last , examination of the profiles by staff familiar with each of the 
EdExAG groups from which the clusu^rs were created confirmed that these 
•roups more-or-less reflected the kinds of approaches actually present 
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in the school-:. The most, valuable result ol r ti*-.--»- nrooedures, however, 
did nof become apparent until the cluster codes wen- attached to individual 
students and until student membership in the v ifi."o , . ; ;:t:u!:. 1 i ion-; ei t wo- 
ven r '' l real men t " pat hs we re exa n i ned . 

os noted it-r, r tie hdueat iop.a I Kxper i one. Anulvuis uuide groups 

identilied during each school year represented t he population of different 
kinds of educational approaches to which participating students were e>:- 
" ; ^ Sl '- J:1 ^ .uiveii sitiool year. KdHxAii groups were nor dc- lined on a lonvJ- 
:udinal basis heca ise ::ir student s in the same IdKxAc croup on 1971-71' 

Mrs. .Joiu-s^ -Vth .crude la:vi;ua;ce arts . lass) wer-- no: : , ooessar i 1 v in 
■ ' 1 l'd:-::-"At; group the next year, this r. is.-n, -eh individual stu- 

dent's IuIlxAiJ group membership was attached to his r-on\L Following the 
cluster analyses described above RdKxAt: c.i'oup . odes w«*re used to create 
:.u- each stuuent a treatment -r< up code ! or luiuuiai:e arts lor 1 ^ 71—7 ^ and 
!'-r 19 7 7-/ i . Crosi?-i abulut ions o: the:.e t w-< end-- w.-re then nir^'to show 
file numbers of studer' ; :'ollowi;vc eU'h ; !,. tuscihle iesgiiu* -a! treat- 
:::en t pa Ins. 

:\xarninat ion ot these tabulations showed that vorv lew student.s tol lowed 
•i longitudinal comb inat ion ot treatments that involved either "c-nerallv 
innovative" ( lTj r ".a ... r ■ i i \ t : e! it: \ • : " f s. ) . 'Since the 
nature of the other treitmen! tvpe-; present dur ; n , : . h w;ir was emiplex 
(thou:;}-, mean i n>;f uj ) and since i ora; i t u:! i na 1 mev.-m-oit «; students across yenrs 

''ducat ional : r • -a t ::a •: : r s o-.-t rime w - ; 7.: : tu produce results 

'■■■hiih wmuIu no? !>»• amenable ?o n. aningful i n : . sp r ■ a a r ; • uj . Kor i'nis reason, 

tvpoie-,:; :1 appr< aei: t ;,„. ;m alv;is <: 7ri' : . a f.M^i ISTKP da's base 

we; re avis id. 'red.. The paper will .-onciud.- wi:s .« r-.vi.-.. c !' the conclusions 
reached . . . . . . 
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Although the coniH.pt of a typology based upon approaches to individ- 
ualization is extremely appealing iron, both an educational and analytic- 
point of view, the results described above nmre-or-less demonstrated some 
of the shortcomings of such a procedure. First, it is possilU that the 
variables used to describe EdExAC group similarities (i.e., the KdKxAC 
scales) were unstable indices of the constructs they purported to measure. 
This is unlikely, however, since the same project personnel visited the 
same schools in both years and since treatment documentation in 1972-71 
was based upon noting changes from the previous years. It is mor- lik.dv 
that ch • 1972-73 EdKscAC data underestimated changes (and were more stable 
than they should have been) . 

Second, the treatment "types" identified tended to be very complex 
combinations of component practices and procedures, with the exception of 
the "generally innovative" and "generally traditional" groups developed 
from the first ()-tvpe factor. There are at least two possible explana- 
tions for tnese results: (1) since the project schools were selected to 
represent a wide range of educational approaches, stable groups could not 
be identified because the sample was both small and very -heterogeneous ; 
and (2) the clustering method used was not appropriate to these kinds of 
data . 

in order to determine if the clustering -esu.lt s were a function ot 
the methodology utilized, the data matrices . ed in the 1971-72 and 1972-71 
language arts analyses were converted to orthogonal principal component 
scores. Squared distances among KdKxAf, groups were compute.' and used to 
fluster the KdHxAG groups by means of Ward's ( 1.963) hierarH.; :a1 grouping 
procedure (Veldman, 1967). Although the mean profiles for a number of clus- 
ters were similar (most notably, the "generally traditional" cluster), 

i v-r.- 1 1 
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there, were still substantial differences between the groups created by 
the two techniques. The hierarchical Rroups, however, were equally com- 
plex and the longitudinal treatment paths of students based on the clusters 
were also complicated. These trends suggested that the cluster results 
obtained were somewhat method dependent. 

This combination of findings also suggested additional explanations 
for our observations. It was quite likely (a) that the kinds of educational 
experiences available to sixth graders were different from those available 
to fifth graders and/or fb) that the practices and procedures themselves 
had changed. Of these two, changes in educational practices over ti.ne 
probably provides the most adequate explanation. At an experiential level, 
at least, numerous site visitors have noted substantial changes in program 
components over the course of this study-- innovat ion, the.., appears to be 
as much a process as it is a unique set of school practices. In spite of 
a number of methodological limitations, the clvrUer results eported in 
this paper more-or-iess led to the same conclusion. 

These results also imply that future attempts to develop typologies 
of innovative practices that are stable across schoo' years ana for different 
samples of schools may not meet with much success. 
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APPENDIX IV-C 

•!i-an:-> , S t anda td l)rv i it i m.-'. - mil 
n t j i c o v r e 1 a t i on s for t h e T u 1 t V a r i a b 1 o s , 
':•»' ~tege of School Year ( -omple t' ed Prior to 
Tost Administration, and SES* 



Abbreviat ions : 

PC L'7 I , Pereen t age of Schot i Yea'" Comple'*.'J Prior to Testing, 
Spring L9 7 L 

PCT72, Percentage of School Year Completed Prior to Testing, 
Spring 19 72 

PCT73, Percentage of Sri. .:•! Year Completed Prior to Testing, 
Spring 19 7 3 

MAL71, CTMM Mental Ar. 1 - L.-guago, Spring 1971 

MANL71, CTMM Mental Age - Nou -tguage, Spring 1971 

RT0T71, LTCY71, AT0T71, CTBS Reading Total, Language Total and 

Arithmetic Total Score for Spring 1971 

RTOT72, L "172, ATOT72, CTBS Reading Total, Language Total and 

Arithmetic Total Score Lor Spring 1972 

RTOT73, LT0T7 j, Ai0;' .'3, CTBS fading Total, Language Total and 

Arithmetic Total Score for Spring 19 73 

S E S , S t ude n t So c i oe con am i c Statu ■■• 
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TABLK i 



Cohort I, Spriiy, 1)72 
Reading Tnt. aJ Score -\r.i 1 _\ s i ^ (N - 7M 1) 



Variab le Me cm St u.Uev 



PCT 7 1 
MAI. 71 
PCT 7 2 
RTJT72 



75.45 
9 3.85 
75. SI 
339.9 7 
1 K). O'J 



A . 60 

1 0. S2 
3.59 
( J. hi 
LO.o I 



>CT 71 



.65 



C ( l r 2" c ' I .it ions 

L\L_7 i" PCTTY"" RTOT 7 2 

. 22 .65 .23 

.26 .42 



2 6 



.26 



.09 



.09 



.41 



. 46 
. 26 
.09 
.41 



i :mrt 1 , :-pr inj; 1973 
Roadie ioLal Score Analysis (N = 767) 



Variable ;-ean Std.Dov. 



^22J_T.£ \? ^ L 01 !? 

p err 7 2 rtot 7 ;f ~ p ct YT~ rtot 7 3 s e s 



PCT 72 75.9 3 3. /6 - .06 -.04 .08 .10 

VrOT72 ,: -fs.46 63.99 .06 - .22 .75 .41 

PCT 7 3 79.95 4.4;< -.04 .22 - .17 .50 

(TOT7 3 400.6^ 5 7.25 .08 .75 .1 7 - .35 

SES 100.59 9.94 .10 .41 .50 .35 
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TABLE 3 



Cohort 4, Spring 19 72 
Reading Total Score Analysis (N = 1952) 



Var iab le 

PCI 71 
RT0T71 

PCT72 
RTOT72 



Mean Std . Dev . 



78.50 
437.91 

75.22 
469.51 

99. 39 



6. 78 
64 . 28 

4.93 
68.6 7 

9. . 9 3 



l CT7.1_ 

.0 3 
.71 
.02 
-.05 



Cor ryj a_t ions 
RT0T71 VCY72 RTOT72 



.0 3 

-.02 
.84 



.71 .02 

.02 .84 

- -.01 

.01 

.08 .37 



-.05 
. 34 

-.08 
.37 



TABLE 4 



Cohort 4, Spring 1.9 73 
Reading Total. Score Analysis (N = 



1.9 25) 



Va riab.lt 

PCT72 
RTOT72 

PCT73 
RIOT 7 3 

SES 



Mean Std . Dev, 



75. 49 
475. 72 

77.05 
507. 40 

99. 74 



5.06 
67, 33 

5. 72 
76.15 

9.90 



Cor re 1 a ti cms 
PCT 72 RTOT72 PCT7 3 RT0T73 



-.03 
.69 
-.10 
- .09 



-.03 

,02 
.85 
. 38 



.69 

.02 

.01 
.18 



-.10 
.85 
.01 

. 3^ 



SES 
-.09 
.38 
.18 
. 39 
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TABLE 5 



Cohort 6, Spring 19 72 
Reading Total Score Analysis (N = 1520) 



Variable 



PCT71 
RT0T71 

PCT72 
RTOT72 

SES 



Mean 



77.20 
513.29 

7 3.83 
5 31.2 7 

99.50 



Std. Dev. 



6.65 
72.86 

5.8 3 
77. 74 

9.92 



-.05 
. 72 

-.02 
.09 



-.05 

-.03 
. 86 
. 3L 



-.03 

-.02 
.00 



-.02 
.86 
-.02 

. 34 



Correlat ions 
PCT71 RT0T71 " PCT72* RTOT72 SES 



.09 
.31 
.00 
.34 



TABLE 6 
Cohort 6, Spring 1973 





Reading Total 


Score Analy , c 


sis (N = 


1552) 






Variable 


Mean 


Std. Dev. 


PCT72 


Correlat ions 
RTOT72 PCT73 


RTOT7 3 ! 


PCT72 


73.91 


5.69 




-.01 


.66 


-.00 


, RTOT72 


545.44 


72. 79 


-.01 




.09 


.,86, 


PCT73 


76.09 


6.45 


.66 


.0 r < 




.15 


RTOT7 3 


56 3.34 


84.84 


-.00 


.86 


. i r ) 




SES 


100.08 


9 . 72 


- . 00 


. 36 


.25 


. 37 
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pc.t ■; 1. 
:l\l7 ! 

PCT72 
LTi 7 2 



Cohort. 1 , Spring 1972 
Laiu;uaj-;e Total Score Ana Lysis (N '= 787) 



Yar.iah lo Mem Sid. 1.V 



7 S . 7 e ^ 
33^. 31 
100 . 05 



io.8: 

h 3 . h 7 _ 
9 . 99 



j'CT 71 

.21 

.h 5 

. 2 3 

. Ah 



Oo'/reJ at i oiis 
MA1.7 L " TcT72 " LTOT72 ' SHS 



1 



2h 



. 10 



3 



38 



.4ft 
.25 
.0 7 
. 38 



.."in ;MK-U' 



TAHLK H 

Cohort 1 , Spr in>» 19 73 
Tot al Scoi\' An- 1 1 v.-; i s (N 



7 r , 5 ) 



PCT 7 2 



;•<;: 73 

,T()T7 3 

(.• ;: (.' 



7') . 

7 ( ' . 95 
.V0(j . 00 



' i . 1 ) 



ro A'lh 



i'(;T7. 

.0 7 
~.0b 



Lorro 1 ,at" ions 
["OT72 PCT73" LTOT73 



.07 - .Pb 



.OS 
.80 



.09 
. 39 
.49 
. 33 



9 . ( 



13 
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TABLK 4 



Cohort 4, Spring 1972 
Language Total Score Analysis (N = 199 5) 



Var iab lo 
PCX 71 

i tot 71 
pit 72 

I TOT 7 2 

t: ^ 



Mean Std. Dev 



78.48 
4 37.52 

75.21 
4 76. 3 L 

99.56 



6. 78 
66. 19 

4.96 
76.27 

9 . 9 7 



'CI7.L 

.07 
.7L 
.04 
-.04 



Corre la ti oils 
! TOT 71 PCT72 " ' LTOT 72 



.07 



.05 



. 28 



.05 

.00 
-.0 7 



.04 
. 82 
.00 

. 34 



S..S 
-.04 

.28 
-.07 

.34 
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Cohort 4, Spring 1973 
Language Total Score Analysis (N = 1902) 



Variable Mean Std. Dev. 



Cor re Lat i qns 
PCT72 LTOT 7 2 ~ PCX 73* LTCK 73 SLS 
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r'CT72 75.46 5.08 - .01 .69 -.04 .31 

LTOT72 480.54 72.24 .01 - .06 .84 .31 

PCT73 77.03 5.74 .69 .06 .Cj2 .18 

LTOT7 3 510.72 75. 7 6 -.04 .84 .02 r .30 

SES 99.78 9.88 .31 .31 .1 8 .,30 



TABLE .11 



Cohort 6, Spring 1972 
LanKiiagi 1 Total. Score Analysis (N = 1 A 9 1 ) 



Variable Mean St.cl.Dev 

PCT71 77. 18 6.t S 

LT0T7L 5 18.89 .69.75 

PCT72 73. 78 5:\85 

I. TOT 72 528.91. 80.09 

SES 99.55 9.9/ 4 



(T_orro_lci t ions 

> iV r7 I.__.j^ , ! 1 J7Xl :p(: ' r " 7 ^ I-TOT72 

-.07 .72 -.01 

-•0 7 - -.0 5 .80 

•72 -.05 - -.00 

-.01 .80 -.00 

.08 .22 -.00 .24 



.08 
. ' } 2 
-.00 
.24 



TABLE 12 

Cohort. 6 , Spring 197 3 
:ngua£e Total Score Analysis (N = 1507) 



Variable 

PCT72 
I. TOT 72 

PCT73 
LTOT7 3 

SES 



Mean Std.Dev. 



73.87 
545. 33 

76. 12 
56.1 .67 
100. 2 1 



5.69 
73.99 

6.47 
82 . 30 

9. 79 



ra72^ 

.01 

.6 5. 
.05 



£° r i"£j jL?i ons 
LTOT72" POT 7 3* LTOT73 



.01 



.08 



.65 
.08 



.05 



15 



29 



SES 
-.0.1 
.26 
.24 
.29 
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TABLE 13 

Cohort 1, Spring 19 7:' 
Arithmetic Total Score* Ana Lysis (N 



Variable 



PCT71 
MANL7] 

PCT72 
ATOT72 

SKS 



Mean Std.L v. 



75.41 
93.83 
75.89 
320.02 
99. 80 



4 . 60 
12. 30 

3 . 5 7 
39 . 80 

9.92 



J1CT7J. 

. 1.7 
.66 
.27 
.47 



Cor re la tic nis 
MANl/71 PCT72 ATOT72 



.17 

. 1 3 
.4 ] 



.66 



.27 
.4 3 



SKS 
.47 
.25 
..09 
. 35 



.09 



.3 r 



TABLE U 

Cohort 1, Spring 1973 
Arithmetic Total Score Analvsis (N 



= 7^ 



Variable 

PCT72 
ATOT72 

PCT73 
ATOT7 3 



Mean 



76.04 
319.15 
179.191 
377. 79 
100.49 



St d. Dev. 



3.81 
38. 14 

4.44 
42.56 

9.88 



Correlation s 
PCT72 A T0T7 2 PCT 7 3 ATOT 7 3 



.19 
-.04 
.0 3 
.07 



19 



.10 



3 3 



.04 
. 10 

,08 
.48 



.03 
. 72 
.08 



SES 
.07 
.33 
.48 
.27 
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TAIVK I : i 



{j Cohort 4, Spring 19 72 

Arithmetic Total Score Analvsis ("N 



Va, iah le Mean Std. Dov 



ITT 7 I 

at en / 1 



rcT 



1 /. 



SICS 



78.41 
4U/4.69; 

75. 15 
-* 4 6 . h o 

99 . 26 



6. 78 
. 37 - rS9 

4 . 9 7 
% .48 

9.94 



.PCT7J 

-03 
.71. 
.00 
-.05 



-f.'i ) -L r 5L! ar *°jl s 
ATOT 7 1 PCT72~ ATOT 7 2 



.03 



01 



29 



•71 
-.0 1 

- .04 

- . 0 8 



.00 
. 79 
-.04 

. 30 



.07 
.29 
.08 
. 30 



Var i ab 1 1? 

PCT72 
ATOT 72 
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TABLF 16 

Cohort: 4, Spri ng 19 7 3 
Arithr^ric Total Score Analysis f N - 



1964) 



Moan Std. Do 
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449 . 44 

77. i,j 
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9<» V-. 
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TABLE 17 







Cohort 


6, Spring 


1972 






r 




Arithmetic Total 


Score Analysis (N = 


1443) 








Variable 


Me an 


Scd . Dev. 


PCT71 


Correlat ions 
AT0T71 PCT72 


ATOT72 


SES 


PCT71 


77. 17 


6.77 




-.01 


.73 


.03 


.0o\ 


AT0T71 


487. 21 


55.35 


-.01 




-.04 


.82 


.30 


PCT72 


73.86 


5.93 


.73 


-.04 




-.05 


-.01 


ATOT72 


510. 30 


72.60 


.03 


.82 


-.05 




'.29' 


SES 


99. 10 


9. 79 


.08 


.30 


-.01 


.29 







TABLE 18 

Cohort 6, Spring 1973 
Arithmetic Total Score Analysis (N = 1505) 





Var iable 


Mean 


Std. 


.Dev. 


PCT72 


Correlat ions 
AT0T72 PCT73 


ATOT7 3 


/SES 


PCI 72 


73.86 


5. 


. 71 




-.02 


.66 


.01 


-.03 


ATOT72 


517. 17 


66. 


, 73 


-.02 




-.04 


.85 


- .27 


PCT7 3 


75.98 


6. 


.47 


.66 


-.04 

m 




.06 


.24 


AT0T7 3 


537. 81 


74. 


.08 


.01 


.85 


.06 




. 30 


SES 


99. 74 


9. 


.67 


-.03 


.27 


.24 


.30 
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APPENDIX IV-D 



Scatterplots of the Residuals about the 
Posttost on Pretest Regression Line 
Plotted on Predicted Posttest 



•k 

On each graph, one occurrence is represented by an asterisk, 
two to nine occurrences,, by the numbers 2 to 9, and more than 
nine occurrences bv a 9. 
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Figure 2. Plot of the residuals about the posttest on pretest regression line (Y 1 ) plotted 

on predicted posttest (Y) — Cohort 1, Spring 197} Reading Total Score Analysis 
(vertical axis = Y'; horizontal axis = Y). 
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on predicted posttest (Y)— Cohort 4, Spring 1972 Language Total Score Analysis 
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Figure 13. Plot of the residuals about the posttest on pretest regression line (Y'l 
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(vertical axis = Y'; horizontal axis = Y) . 
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Figure 15. Plot of the residuals about the posttest on pretest regression line (Y 1 ) plotted 
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Figure 16. Plot of the residuals about the posttest on pretest regression line (Y 1 ) plotted 
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(vertical axis = Y'; horizontal axis = Y). 
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APPENDIX -IV- E 



Guidelines for the Use of Multiple Regression, Commonality Analysis 
and Levels Analysis with Multi-Level Predictor Variables 



A' Intr oduction 

The utilization of multiple regression analysis and variance partition- ■ 
ing techniques has become increasingly popular in the educational research 
community during the past decade. Th Ls appendix contains a review of two 
such techniques, commonality analysis and levels analysis, as well hs a 
discussion of how these prccedures were used to analyze the multi-level 
data collected by Project LONGSTEP. $ 

B_._ Data B ase_ Overview 

Project LONGSTEP "was designed to be an associational stud.y in which 
student outcome measures could be related to quantitative descriptions of 
each student's educational environment, as vie I 1 as to his/her home background 
and initial achievement status.* Cognitive and attitudina.1 outcome measures 
and student background data were obtained from individual students by means 
of standardized achievement tests and questionnaires. These variables, by 
definition the.n, were student-level variables, since they were measured at 
the individual student level. 

In many large-scale studies, all students in a school are assumed to 
have had exposure to exactly the same treatment and teachers; In fact, 
the teacher characteristics variables associated with students are usu- 
ally aggregate measures computed across all teachers In a school. In 
Project LONGSTEP, however, the teacher and treatment data assigned to a 
given student involved the attributes oi ,lv those teachers and treatments 
to which that particular student had been exposed. Furthermore, teacher 
and treatment data were independently attached to individual students 
because not all students exposed to the same basic educational approach 
(i.e., treatment) had the same teacher or combination of teachers. A ✓ 
single measure of each teacher attribute was created for 'each .student With 
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more Chan one t cache r in i g iven sub j ee t ma 1 1 er area of i ns r rue t i on 
(language arts, math, si * i 1 studios and science) by aggregating these 
data to the individual student- leve 1 . Although more than one student was 
exposed tn a given teacher or combination of teachers ( i . c . , students wen 
nest«- ' teachers or teacher combinations), the number of these comb It 

Cions w.i . ..i: f icient ly large (across all students in a given analysis dat: 
set) that the teacher variables were viewed as student - 1 eve 1 variables. 

As noted throughout the body of the report, the data collection unit 
for educational, treatment: data was a flexibly defined entity railed an 
Kducational Experience Analysis Guide group or KdI\xA(i group. Different 
KdExAfJ groups were identified within a school when an AIR sire visitor 
eould differentiate among the treatments received by different groups of 
students at a school by means of items found on this guide, Defined in 
this manner, these groups could include as few students as those within 
one teacher's class for one-subject matter are.i of instruction or as manv 
students as those in all grades within a school for all subject matter 
areas (i.e., Language arts, math, social studies and science). KdKxAG 
groups, then, were created in response to treatment variations that exist* 
within i school and within a grade am' may be viewed as an efficient hut 
group-level approximation to the quantification of each individual stu- 
dent 's educat ional treatment. 

It is important to note that KdlixAO groups were not created specif i- 
ca 1 1 v in response to variation with respect to the scales developed from 
Hie items on t he lid K ".AG 1 s . As just in > Led, different KdKxAii groups were 
identified within a school when an AFR s. i te visitor omhl differentiate 
among t he treatments received bv different groups of students at that 
school by means of items on the KdKxAC. Thus, two groups of students ioul 
!>«■ 1 ong, to two d i f ferent KdKxAG groups because (a) two d i t f erent -a boo 1 s 
were involved and KdKxAC groups did not cut across schools, or (b) two 
/roups within the same scliool could be differentiated on the basis ol one 
• r -more KdKxA(J items. Since different combinations oi it<-m:, eould lead 
l in same scale score on a mult i- item seal.-, it w.e; ao^sihle tii.it tyn 

/ 

\\\ :-. AC . groups were idiyit if ied within a school been us,- oj f w< . discrepant 

/ 

o 22)) 
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items, but that the two groups hail exactly the same scale score on the 
scale of winch the items were members. In summary, Ed Ex AG groups did not 
have to be different with respect to EdExAG scales because the variables 
used to define groups (i.e., the EdExAG items) made finer distinctions than 
d iii sea 1 es . 

Figure E-J contains an example of the multi-level nature of the I'rojec 
EONGSTEP data, assuming two sites, five schools, one quant i tat. i ve EdExAG 
variable with three levels, and seven EdExAG groups. The nesting, of EdExAG 
groups under levels of the EdExAG scale that is illustrated in Figure E- ] 
reflects the LONGSTEP approach to treatment documenation — that is, 
different treatment groups are not necessarilv different w'i t li re.-juvt 
to all oi the basic component* underlving educational programs. 
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because of the particular pattern of nesf.ing pr^^u in t he E» Ev;s i EE 
'l.Ua, differences attributable to EdExAG croup d i f r eia-in ec alone would ad 
involve three com|iou^ts — d i f fc runa - nrxonc sites, d i l Ven-nn-s anmnc. sob, 
" lthl:1 siLlS iHid differences ar.onj. EdExAG croups within s, hoe I s *< see Eixui 
Sinee the treatment data were to in- t he primarv foci oi the analvsis 
conducted by the project, however, the analytic models did not involve the 
examination of site-level or school -! .-ve I differences. R.ither, posttest 
variation that could be attribut-d to the quant i t a t i vc EdExAG* seal es or to 
differences among EdExAG groups were studied. 
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There were.', therefore, two different levels to the data analysed by 
Project LONGSTKP — (I) the stud e n t - 1 e v e 1 y a r i a h 1 e s such as the test score 
a 1 1 i t ud thai and hac kg round measures , and teacher at t r ibut lks a t t ached t o 
individual students and (25 the lldLxAG- 1 eve I data such as the KdKxAG scale 
themselves or the dummy codes which noted KdKxACl rroun mor >. 

Commonal ity Ai i al ys i s 

in the usual multiple regression approach, t lie investigator is likt.lv 
to assume that some decree of prppnr t iona 1 i t y e:-:ists between a variable's 
indepenc. ' contribution to the prediction of the criterion and, its causal 
influence .aid then proceeds to make inferei a/s iavardiiu; the processes 
beim: studied. Such an a -:- - oach niav be usetul when predictor variables 
are uncor related with one another, because cacti variable's tiniqu. cou^- 
trihution then expresses the onlv linear relationship it has with tin 
cr ite* 'on. However, when predictors are i n t e rear re 1 at ed , enci; variable 
that is corielated with another predictor will have ussoc i a t i ons witii tin- 
criterion that it shares with the variables with w'n ic h it i s correlated. 
Furthe r::x>re , these joint re lat ionsh i ps vaivnot be interpreted direct iv 
because it. is not possible to dc t t-rm i ::e : (1.) t ne extent to which the 
shared influence of t he variables should. In- apportioned to the individual 
variables in that comb inat i i ;. ; or I, J > the eat t:U to wnich the sha red in- 
fluence represents coopernt i w i a f i in -r.c ■.■ ■; el Liu var ; ihl.-s in t ii.it 
comb L na t i on . 

<r 

The st udent- 1 eve 3 .nit come measure-: colKsttd bv i'l'-'ji-ct [ ( )yj;SThT are 
known to he complex measures .-/hose variance c<n be r«-lat*al f o i nurshor of 
source:-;. Some of theSe N.-'iPes iTe h«'V>nd tile inil i"!^'- 1 I iea school, 

for example, student st >c i Of. a.r*. i , :> j 
as t'ne educational treatments to whbss .; 
are amenable to cent re 1 bv sdii'-d <oi i i 
STKP ii a s been to asses s t he •■ f f e<- 1 . ■ ! ; s k 
a. s taiuc.it i o n a 1 treatment c i i i r . i c 1 1 • r [ •; r i , 
.r» >\s- tin !■! !\rt s of unta sit r ■ II in 1 1 ■ in;! 

at t a 1 na p:r- ■ » a the si ud - / a* . i ai it <•;. i - 
1 a t of [a. a t i pt -r I on:: ass w ml d !>.■ i 



r< nin-i or s.s • a her s, >ias. s , su- h 
: ad- ait s a. is ■; ah } » •< 4 t a , in >VO -ve r , 
ils. 'liit- ;»". r pt 1 s- ■ ot Project it rn 
-nil '.a ■ t 1 1 r - ] \ . p » 1 . • .s i r i ah ] . - s 
a a ve 'Si s •■ , .o j i < a t • s «".,! • ••, >v< * r-a n d- 

»• • a« • ' : i: cr o ; ia • :>rre 
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and that an assessment of the influence of a given variable would require 
examining the effects that variable shared witli other variables in the 
model. The commonality analysis approach, Involving the computation and 
examination of all the components of predictable criterion variance, appeare 
to offer a level, of analytic detail that would facilitate insights con- 
cerning the intertwined influences of the background, treatment, and cri- 
terion variables being studied. 

Commonality analysis is a technique that yields a series of coefficient 
which express the extent to which each independent variable (or each set of 
independent variables) in a multiple regression equation (a) is a unique, 
non-overlapping predictor of the criterion and (b) is a confounded predictor 
ot the criterion due to its correlations with other independent variables 
in tile model. Kssential.lv, 

"... the squared multiple correlation is broken up into 
elements assigned to each individual regressor and to 
e a c h p o s s i b 1 e c omb i n a t i o n of re g r e s s o r s . Th e elements 
have the property that the appropriate sums not only 
add to squared multiple correlations with all repressors, 
but also to the squared multiple correlation of any subset 
o f va r i a b 1 o s , including the si mp le c o r r e 1 a t i on s ... . 
Commonality analysis does not tell us anvthing that 
cannot he deduced from a table- of squared multiple c re- 
lations. However, co mmo na 1 i t y a n a 1 y s is does help us make 
comparisons in an organised manner." (Beaton, 197*, p. 2) 

Commonality analysis lias been described, as well as extensively used, 
by Maveske and his colleagues (1972, 1973a, 1973b) in their re-analyses of 
the Equal Kducational Opportunity Survey data (Coleman et al., I9un). iqher 
authors (Beaton, 1973; Kerlinger and Iedhazur, 1973 ; Mood, 1971; and 
Tatsuoka, 1973) have also discussed this method. The ba . ' • model und. -riv- 
ing the procedure assumes that prediction of a criterion variable can be 
attributed to a "unique" contribution of each of the- predictor variables 
and to the "common" contribution of all combinations of independent, vari- 
ables. Ir, for example, there, are three sets oi pred i ctor, var iabl es-- 

Si-S(S), Pretesi(P) and a series of k duinmv variables ([).) encoding membor- 

i 

slu P in k bdKxAC groups — and if we let a itn i.q ueness be . svnibo 1 i zed bv I- ,unl 
a commonalitv by C , the total -mil ip!e correlation ('.quar. i PlK ., h , s . 

fi-r(S,P,I). J 1 would be, 
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R (S,P,D.) = U(S) + U(P) + U(D ) + (e- 
+ C(S,P) + C(S,D.) + C(P,D.) + • • - 
+ C(S,P,D.) . 

These 2-1 additive components express the (a) unique predictive effects 
of each of i regressor variables (or sets of variables) in the system; anc 
(d) the joint and inseparable influence of each of the possible combinatic 
of the c regressor variables. The uniquenesses are computed first. The 
dependent variable is regressed on the 2, independent variables and then or 
all possible combinations of the l-l predictors. Given the throe predict 
sets of SES(S), Pretest (P) and the dummy variables (D\), these squared 
multiple correlations wouLd he, 

R 2 (S,i\ P.); 

R 2 (S,P) ; 

R 2 (S,D.) ; and 

R 2 (P,D.). 
1 

The uniqueness for each variable (set) is then computed by subtracting frc 

the R*~ for all three predictor sets [R (S,P,D.)], the R^ of the regressior 

\ 1 
model from which that particular variable (set) has been dropped. For 

example, the uniqueness for the dummy codes [U(D.) ] would be equal to 

R 2 (S,P,D.) - R 2 (S,P) . 
L T (S) and U(P) would be computed in similar fashion. Thus, 

U(S) = R 2 (S,P,D.) - R 2 (P,D.); and 

t(P) = R 2 (S,P,D.) - R 2 (S,D i ). 

The second- order commonality coefficients , symbol ized as C(S ,P) , 
C(S,D.) and C(P,Dj, are obtained by subtraction. Since the commonality 
model implies that the correlation (squared) between the criterion and the 
k dummy variables , D. , is 
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R~(D.) = L'(U.) + C(S,D.) + C(P,D.) + ••• ^ E - 2 ) 



+ C:(S,P,D.) ; 



,2 



subtracts R ( V , „ (s) „„„ „.<„, ^ a kvivts t|)c m ^ 



rommonal i trv C(S,P) : 



R 2 (S,P,D.) - R 2 (D.) - U(S) - U(P) = 

1 ■ 1 (K-3) 

fU(S) + U(P) + U(D.) + C(S,P) + C(S,D ) + ... 

i i 

+ C(P,D.) + C(S,P,D.)1 - [U(D ) + ... 

+-C(S,D,) + C(P,D.) + . . . 

+ C(S,P,D.)| - [U(S)1 - [U(P)] = C(S,P) 



The other second-order commonality one f f ic Leni s , C(S,D.) and C(P,1) ) Ml . 

i i. * ' 

computed similarly. The third-order commonality coefficient. |C(S,P,H.)1 is 

2 J * 

equal to R"(S,P,D ) minus all the lower order commonalities and the 

uniquenesses . 

Approximately the same methodology is used to compute the coefficients 
for problems involving other numbers of predictors. Mood (1969) and 
Kerlinger and Pudhazur (1973) have presented general formulas so that a 
commonality ana Lysis can be performed with any number of predictor vari- 
ables or variable sets. 

It should be noted that only a uniqueness may he viewed as reflecting 
a proportion of criterion variance. This is because a uniqueness is a 
multiple part correlation squared; tiiat is, it is the square of an 
independent variable (set) with the., rr i ter ton , after that independent 
variable (set) has been res i d ual i zed on the basis of all of the other inde- 
pendent variables in the model. Second-order coefficients, such as C(S,P), 
and third-order coefficients 1 ike"' C< S , P , D ) , on the other hand, are not 
proportions of criterion variance but are .relative measures of the amount 
of predictive overlap of the variables or variabLe sets involved. Negative 
lugher-order commonalities are possible and indicate that the explanatory 
power of one variable (set) is greater when the other variable (set) is also 
in the model — a sort of suppressor effect. 
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D. Levels Analysis 

One of the most general and potentially useful analytic techniques 
which can be utilized with any multi-level data base is a variance partiti 
ing technique .sometimes called "levels" analysis. In brief, this procedur 
involves regressing a student-level criterion variable on a set of dummy 
variables, D^, which encode membership in k mutually exclusive groups, 

such as EdExAG groups. The square of the multiple correlation obtained, 

2 

R (D^) , indicates the proportion of variance in the criterion variable 

which can be attributed to group differences. Stated somewhat differently 

2 * 
P*"(D^) will indicate the proportion of variation in a student-level 

criterion variable which can be predicted from knowledge of group member- 

2 

ship. Furthermore, the R"(D^) will reflect the maximum proportion 'of 
student-level criterion variance which can be explained by any and all 
quantitative predictor variables defined at the group level. To understan 
this, one must first appreciate how a multiple R~ is obtained when a 
student-level variable is regressed on a series of bina. /-coded variabl es 
encoding mutually exclusive gcoup membership.^ 

Let us examine what happens iiv^i two-grtfup situation Jescribed by the 



win* re 



bjXj + b 9 X 9 + e. , (K-4) 



= criterion v.i:"i;.ble 
score for st Jc -it 



n 



X* = 1, if student j , : r "i r of 
j group 1; 0, if , ro:n rrowp 2; 

= 1 , if st udon t j Is a niombe r * o f 
j group 2 ; 0 , if f ron ^roup 3. ; 

b ^ and b f? = least s^ua res raw score' rearers i-on 
ecu- f f i c i ent s ; 

Cj = an error component for student j. 

Tab 1 e L shows the Y , X j , and X 0 scores for Lh ro.v s t 11 dun r s i n 0.1 ch o 1 
two groups . 



2 3 3 
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TABLE 1 

Example of Levels Analysis Data Matrix 



. ____Y \ h , 2 _ 

r 

2 1 0 0 0 

3 ' 1 0 I . ] 
1 3 0 -1 l 
5 0 l 0:0 
6-0 .1 | i 

0 .1 -i ] 

The solution : ^r the multiple correlation, R , of Y with Xj and X 0 
will involve the selection of raw score regression weights for the vari- 
ables X and X 9 such that the squared difference (i.e., the square of the 

2 ' / 

prediction error, e ) between the actual criterion score (Y ) and that 

j 

predicted on the basis of those weights is a minimum when summed over 
V ? 

all entities (secNoj in Table 1). Now, if Y ! is the predicted value of 

Y . , and I 
J 



Y i = b l X l + b 2 X 2 ' 
J J 

what values oi b^ and b ? will minimize tlie sum of the squared errors in 
prediction if, from equations '"-4 and E-5, 

cV - i'Y a - Y!) 2 ? 

iir.nt, by subs t i t ll i ng c-ju-'iL-u-.a K-5 into equation K-6, wc have 

^ - I ' j - (bjXj + b 2 X 0 ) I 2 ; (K-7) 

" j M 

and , h 

E eT =- E [Y - (b X + b X )| 2 . (K-8) 
j«l J j*l J \j 2 2 j 

Next, let us enter the data in Table I. above Into equation K-7*. For these 
six students, equation i r .-7 becomes, 

' • 23ti 
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e x = [2 - (b 1 l + b 0) ]■ 



l e 2 = [3 - (b 1 l + b 2 0)]" 



e. 



= [1 - (b x V+ b 2 0)T 
= [5 - (b^ + b 2 l) r 
= [6 - (b x 0 + b 2 l) ]' 



ej - [4 - (b l0 + b 2 l)] Z . 

Note, however, chat for student 1, equation E-9 reduces to 

<-• er = (2 - bp- . 



> 

' '(E-9) 
(E -10) 
"(E-ll) 
\ (E-12) 

([•:-! 3) 

(E-14) 
,(E-15) 



In fact, the same pattern holds true for all students in group one (i.e., 
for whom X. equals 1) . 

For student 4, equation E-12, 



e: = [5 - (b.O + b„l) ] 2 ,, 



becomes 



= (5 - b.,)~. 



(K-16) 



Likewise, the same pattern holds true for all students in group two.' 

Examination of equations E-15 and E-16 indicates that minimizing 
the overall prediction error (see equation E-R) actual lv involves mini- 
mizing two suics, 



T. (Y - b ) 2 and L SJL - b 0 ) 
1-1 J j« 4 - 



Since the groups are mutually exclusive, minimization of th.e prediction 
error for the two groups separately wi 1 1 minimize the prediction error 
for the two-group .system. Because, by definition, the mean is that point 
about which the sum of the squared deviations is a minimum, b must equal 
the mean, of the criterion variable for all students in group 1 and b 
must equal the mean computed over all students in group 2. 

IV-E-10 
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IhO'implicacion is that when one uses binary coded variables \o encode 
group membership, the raw score regression weights yielded by regressing 
the criterion on such predictors turn out to be the mean criterion score 
for the students in each of the respective groups. Ttfe mean of the depen- 
dent variable. in each group is of course a ■ group- Love 1 variable; that is, 

it is a single value which can be associated with, each student i ti a given 

? 1 

group and has no in t ra-group , var ia t ion . * v 
i •* 

. The 'proportion ot criterion variance that can be attributed to aft mean/ 

differences among groups with respect tc the criterion, R 2 (D.), is also- 

known as eta square [rf(D.)] and, in effect, involves fU-ting a regression 

line through each of the group means. ' The presence of k groups means that this 

regression*^ ine may have a linear component and k - 2 nonlinear components 

in order for it Lo pass through each of the group means. There fore s i lire 

ic JLyi^ m >A c, . s l ) ic amount of prediction error for each group .separatel y and 

involves a group- level variable (i.e., the group means on the criterion) 

whose linear an if nonlinear relationship to the criterion is a maximum, a 

levels ana Lysis 

< I) quantifies the amount of among-gnnip and within- 

group variance present in the criterion 

variable and thereby 
(2) 'sets an upper limit on the proportion of criterion 

variance that can be attributed or related to any 

and all group-level predictor variable or variables. 

_ A 0 &r5l^AL 0 R_ j? nc L Qommo naj_i t y_ An a 1 vs i s 
wjith_ M^iJ^J — J^eyc- J_ Pr ed i c_t ur Variab 1 es 

T.n order to understand the use of regression analysis with multi-level 
niV-dicror variables, it is first necessary to examine the . w i I h i u-j;roup and 
-Mnwa^-group components present in zero-order correlations. If two student- 
l;*ve.l variables, X and Y, are measures obtained on students who are members 
one of k groups, it: is possible to partition the deviation ■ » f uaeli score 
! rom its granu moan into n wit h in-.:rotip and nmon^-r.roup poj-t ion. Thus, 

IV-K-ll 
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where , 



X ij f X = ( X i j - \) + (X. - X), and , (e-17) 
Y ij - 7 = < Y i.j -"V + (Y. - YT, . • (E . 18) 

X-j and Y A . = raw scores on two student-level variables, 
X and Y, obtained by student j in group i; 

X and Y = Lhe grand mean of variables X and Y computed 
over all students; and 

X. and Y. = the mean of variables X and Y for the 
students in group i . 

The formula for the Pearson r between variables 'X and .Y is 



k »i 

I Z (X,, - XXY,, - V) 

r = ..r ] ..J= l 

i=l.-Jj=J__L_ / i = l j = l 
N N 

where, 

r = the correlation between student-level variables 
X and Y; 

k = the number of groups; 

nj = the number of students in /roup i« 

n[ , the total number of students in all k 
i= 1 groups . 



It is then possible to substitute equations K-l 7 and K- 1 8 into equation 
E-19 wit h tile resu 1 t . 



2 3!) 
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V 



H 



xy 



K-20) 



[ £ -ya'ij + E ni (x. - xxy. - ?) 




' k 11 i 
i=Lj=l 

k 



k 

V;) 3 [n,(V[-vr 
- t K\ 



Note: Crossprnducts of wichin-nroup deviations with amnm^roup (irviat ion.- have no! ken included 
Equation K-20 sineetliev all sum to zero; that is. 



k : ni ' k ni 

I [(X..-X.)(Y. -?)?£ 7(Y, 
i=l i=i . i=l i=l 



Y.)(X. - X) 
i i 



k n i ... k S 

I E(X.. -X.)(X. -X) = [ L (Y.. 

i] ii 1 1 

i=l j=l J i=l, .1=1 



Y.)(V. - Y) 
i l 
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l.t i.;^much less complex, however, to discuss the within-group and among-group 
componeats in equation E-20 in terms of covar*. ances and variances. Thus, 
equation E-20 can be rewritten as 



Cov (W") + Cov (A) (E-21) 



r 

xy 



Var^(Wj + Var^CA) Var y (w) + Var^(A) 



where, 



Cov (W) = the mean within-grou p crossproduct of 

deviations from the group means for variables 
X and Y; 

'i ' . ' 

Cov (A) = the mean among-group crossproduct of deviations 
from the grand mean for variables X and Y; 

Var^(W) and Var (W) = the within-group variance for variables X and Y; and 

Var^(A) and Var (A) = tne among-^group variance for variables X and Y. 

Thus, the correlation between two student- level variahles, l ike 
post test and SMS or pretest and SES, is, |n fact, composed of wit hin-g roups 
and among-'groups covariances and variances*. Consider for example, the 
levels analysis case where a s tuden t- 1 evel dependent variable Y is 
correlated with the mean of that variable computed at the EdExAG group 
level. In this case, one substitutes Y. for X.. and Y for X in equation 
E-20. However, the with in- groups component r will drop out because Y , 
by d e f in i t ion , has no wi thin- group var i a t i or. , that is, 

k n i . 

£ (Y. - Y.M'Y. - Y.) 
i=l j =1 l 11 i 

= fov ^ = 0 ^ Q (E-?2) 

k yy 
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I V- K- 1 4 



= Var .. i\-~2V 



v 



k n i 
k 



Kquation K-21, for the case where- a s t udon t - I evo 1 variable V is rerre- 
iated wiLh the group mean on Y, thus becomes, 



Cov (A) 
vv 

r vv- = r— -7^=^^: ■ " • ( I-:- 

./ Var (A)*/ Var (T) 



;t)c r 



r - = the correlation between a s t uden t. - 1 eve 1 variable, \ , 
1 and the group means (V.) for that variable and 



Var^(T) - the total variance of variable Y,*or, I Var .(W) + V, 



r (A) 

v 



.However, when a variable is correlated with its group-level nean value, its 
anong-groups fo.vaj^anco , Gov (A) is equal to its among-, • 1 , 4j • ^rianre, 
Var (A). Equation 1--24 then reduces to, 



Var (A) 

r vv, = I " ~~~~ y '~ , ; and (K-71) 



*/ Var (A) ./Var (T) 



Var (A) • V.*r (A) Var (A) 

r 2 _ = y .}*___ = y • (i:-; ? b) 

yyi r Var (A) • Var (T) Var (T) 



v v 



These derivations ' ■ onj unction will. the. 1 eve is analysis derival inns 
a^iin show that* the square of the correlation of a s t uden t - 1 eve 1 variable 
wilh a series or dummy variables encoding L'dl'xA^ group members!! i p is 
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Var (A) 

'vvi = R_(D i ) = vTr^T) ' (F - 27) 

' y 

-ho ratio )f asnong-gro' p variatio., to the* total. 

The implication of these results , :>r using a series of dummy codes 

as predictors of a student-level criterion variable along with one or 

more student-level predictor variable(s) is : : at these other variables 

can account only lor wi thin-group variation in V — because all 

variation in Y that exists among groups can ue related to, or is completely 

confounded with, the dummy variables, D , . Since Var (T) = Var (W) + Var (A), 

l y y y * ' 

the proportion of variance which can he related to any and a ]'] student- 
ievol predictors (above that at t r i^utnb I o to group differences) is 

Var (W) 

■ 1 - R-UJ = 1 - = Var - (T) • (F-28) 



This same logic, of course, can he applied to all of the correlations 

among any student- leve I variable and a series of multi-level predictor 

variables. For example, the multiple correlations squared of Sj;S(S) with 

2 

the k dummy variables [IO'D.)] would be nothing more than a levels analysis 
o: SES and would be based upon among-group variation in SKS: 



0 Var (A) 

2 s 



FTCDl) = r\. = - r : 'r~^ ' (1-29) 
s ssj Vnr^(i) 



Jt i true that ir(D.) or r~- quantifies the ;aximum proportion of 

S L S s j 1 

varia? i- :. in SES that is occu. "ing .imnnj/. groups. 

Since it can be shown that all among-groups variance components of 
all student-level predictor variables are who 1 .1>\ confounded with the 
k dummy variables , only w i t h Ln-groups components of the student - level 
predictors will remain to be related to each ochor and to the dependent 
variable if the student-level predictors are residua 1 i^ed on the basis 
of the k dummy variables. Let us examine the composition of such a part, 
correlation which, when squared, is, of course, the same as <■. commonality 
ana 1 ys is uni queue ss (V) or f 1 rs t-order commona ] i ty coef f i c i ent . 

IV-H-.ln 
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Lot V be the dependent: variabLe, post ti'st ; S he a student - 1 eve 1 
variabLe, SKS; and I)., a series of k duminv variables encod Lnu KdKy.AC group 

L ' .T.I 

membership. The correlation (squared) of post test with that part oi SKS 
win eh is independent, of or une.orrelatod with Kd !".:•: A< : "i"uip membership is 

• <-; ( ,. v = 4- • ■ ' (K--«n) 

N 

\ 

wh e r e 

s 1 = the deviation of s. the SKS seore for student j 
in group i , from 1-1 the SKS mean for all students 
i n group i . 

If s!. is substituted into equation K-2U for X , the among-*.- roups v 
components of the posttest/SKS cor re 1 a t i ■ . ; will drop out since- s 1 - s f -- ().()• 
that is, the mean deviation ore for each group and the over- 
all mean of the deviation scores are both equal to zero. Similarly 
the ar.ong-groups component of the- variance of the SKS residual would * 
drop out. Since all of the covariance of variabLe s' witl/y would be 
with in- groups covariance [i.e., Cov (W) = Cov ^ , (T) ^ s ince Cov , (A) - () | , 
and since ail of the variance of s' would be w[ thin-group variance, 
equation K-J] won Id become, 

Cov (W) 

r v s 
v ( s • d j ) = r , - -,. . - - - -■ - - . ( K- 3 1 ) 

, Var (W) V,ir CD 
\ s \ 

From equation K-28 it follows that 

\ ir ,(W) = [Var ,(T) | • [ 1 - R Z (\). )\ .•(!■> 12) 

s s s 1 



Cov, ( f W) 

= r 



y(s-cii) — — ~ 

• I \ a r ( i 



I Var (T) I*! 1 - R~(i) f ) | Var (T) 

v ■ s \ " 

Kqua .on K-3'3, for the part correlations may also bo written as, 

Cov (V.) 



r ir (TJ : Var fT) 
vs y ( s -d ; ) = • - , - - . ( 1. j' 4 j 



^ 1 - KsH) f J 
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ERIC 24j 



These do riv.it ions su^'^'s L [hat 

(a) all among-groups components of s t udon t - love \ 

predictor variables are completely con- t 
founded with a scries of dummy variables 
eneod ing group membersh i p ; 

( b) the un iquonesses or f i rst-ord ■ r commona 1 i f i es 
for the student-level variables in a commonalitv 
analysis of a multi- level predictor model 
reflect proportions of criterion variance artrib- 
utab 1 e to wi tlfin- group covari at i on wi th the 

c r i t or i on ; \ 

(c) higher-order commona tity coefficients indexing 
overlap among student- level variables 
reflect wit hip-group confounding because ail 
gro up- 1 eve 1 va r i a t i on is con founded with 

th e d ummy va r i a b 1 e s ; 

(d) the first-order commonality lor the dummy 

va r i ab le set would i nd icat c tli e propo rt i on o 1" 
cr L t or ion va ri ance among groups that is no t 
■ .confounded with any group d i f f erenccs wi t h 
respect to the student- level variables: and 

(e) the higher-order commonality coefficient^ 
involving the dummy variables inde:-; a 
group- leve 1 component present in t ne s i uaen t - 
level Vririable(s) that is confounded with 
group d if f ere nee s ince cor re la t ions, w i th t h e 
se t of dummy codes arc f une t i "us of mean d i. !"- 
ferences or among-group variation only. 

One important" implication of these conclusions needs to be 
mentioned at this point. When a large number of mutually exclusive 
groups are involved, some investigators have computed the criterion 
moan for each group and then used th\s new variable, as a single group- 
level predictor instead of an unmanageably large number of dummv variables. 
If one is only attempting to partition trie total variance in the criterion 
into among-group and w i thin- group components, the square of the cor re- 

T 

la t ion between the criterion and the group criterion means wi. 1 1 provide 
this result. However, a multi- level prediction model including this 
vector of means. (Y.) and a number ol s t udent - 1 e ve 1 variables as predictors 
is not necessarily equivalent to a regression model with Mi.- same student- 
1, ' v " 1 '" ,r '' ,,,,U ' s ■ ln ' 1 ;! -ories of dummv vuriabUs encodim-. \:vo U p membership 
as predictors; that i:., 
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R 2 (D.) = R 2 (Y.) , but (K-35) 



2 



K (S,I\D.) > R^S.P.Y.), (F _ 36) 



S = student SI'S, 

P = student protest, 

IX = a series of k dummy variables encoding membership 
in one of k g ro up s , 



Y . 
1 



tlic^ cri terion variable mean for one of k different 
groups . 



V One very obvious reason for the differenee is that the group- level 

variable Y can only have linear correlations with the student- 1 evel pre- 
i " " ' • 

die tors in the model. Thus, t lie only confounding that can he present in 

the model is that which is attributable to a linear correlation of the 

student-level predictor variables with Y.. In otJ)er words, although the 
■ l 

regression line of Y with the D. would fall exactly on each Y. and the 

l l 

^regression of S with D r would fall directly on S. ee Levels Analysis 

l l 

discussion), the regression of S on would not pass directly through 

all S. uriiess the correlation between Y. and S. were 1.0 — see Figure K-2. 

1 k 0 9 1 1 

(Tn other words, R (D. ) will equal n (D.) only when the s. fall exactly 
si s j 1 

on a straight line.) This would tend to result in an under- est ima t ion 
of the degree of confounding between group membership and the student- 
Level predictors in the model, in an over estimation of the uniquenesses 
for the student-level variables and in an inaccurate assessment of the 
wi thin-groups confounding for the various combinations of student-level 
predictors. It is important to remember, however, that the multi- 
level predictor model with the criterion group . means O . ) is really a 
different analytic model from the mult 'vel dummy variable model. 
The mean vector model (i.e., the model with the Y. as one predictor) 
will have only linear among-group covariance components with 'the criterion 
and with the student-level predictors in the model.. On the other hand, 
the dummy variable model will isolate all variance sources that are 
correlated with group membership, without the requirement that the 
correlations with the group-level variables (i.e., the dummy variables) 
have only ii.near amqng-group components. 
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Group 1 Group 2 Croup 3 Group 4 

Yj = 100 Y : > = 200 v Y i = 300 Yi, = 400 

Legend: S = student-level predictor variable, *SKS; 

S i , S;. , S , S; t = mean SES scores for stduonts in groups 
1 to 4; N 

Yl »Y : ? ,Y3,Y t4 = criterion variable (Y) mean for all 

students in groups 1 to 4 respectively; 
* 9 

= regression line for R^(D^) which falls 

.directly on each S^; and 

- - - = linear regression line fitted to each 

Y . S . pair, 
li 



The term "line" is used looselv here. Actually the structure on 
which all S. values lie is a regression hyperplan e since in a 
leve 3 s-anal vs is each group is represented by a separate (dummv) 
'predictor variable. 

Note: Only when r- - =1.0 will-the two regression lines coincide. 
>'i s i 

Figure E-2. Example of a student-level variable regressed on a 
series of dummy variables encoding group membership 
and on a vector of criterion var : able group means. 
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The preceding discussion has dealt primarily with a run It i — 1 l* v i • J pre- 
diction model in which the group-level prodio\or var iab les were a series of 
dummy variables encoding FdKxAC group mcmbersh i*p . Pro j ec t ! .ON' IS 1Y.P, however, 
used the Educational Kxporionce Analysis Cuide not only to differentiate 
the groups of students within a school who were receiving different eduea- 
* t iona I treatments but also to document and quantify the eduea : 1 oua ) attributes of 
these different approaches. It was possible, therefore, to use the scales 

developed from the EdKxAO's as a series of KdKxAG- 1 eve 1 predictors instead 

•> 

of the dummv variables. Previous sections have shown that: R"(D.) indexes 

i 

the- proper t ion of variance in the criterion that is occurring among groups 
and that can be related to any and all group-level variables. Hie correla- 
tion (squared) between»an EdKxAG- \ eve 1 variable such as the Utilisation of 
Objectives (Xj) scale and the student- 1 eve 1 criterion '.V) will almost 
always be less than Pr(D[). In tact, it can he shown that FT(I)j) and r"j 
will be equal only when the linear correlation between the criterion variable 
group means (Y ) and the EtlExAC variable is 1 . 0 (see I*'ig. 1-2). As with all ^- 

EdKxAG- level variables, the correlation between Utilization of Objectives 

i 

C^j ) ana " «my student- level variable will 'have only an amoug-group covariance 
component. [f X. is substituted fe. X'., in equation K-20, the within- 
group covariance and the '- f n- gt'oun variance for Xj will he equal, to* 
zero since a group-level variable, by definition, has no int ra-group vari- 
ation. In terms of equation K-21, then, the r correlation is equal to. 

V x i 



Gov ( (A) 



(V-M) 



+ Var (A) ; Var (T) V 
> x, > 



Because X, is a group- level variable, ana, 



V a r 



(A) = Var m , 



9 A r * 

Ci 4. 



equation E-37 can also be written as 



Cov.. x (A) 

vx = • <K-39) 



V Var X) (T) y Var^T) 



9 • 9 



The difference between r" and fT(D.), however, is not due only to 

v A j 1 *_ 

the presence of nonlinear components in the correlation between the depen- 
dent variable Y and Ed Ex AG variable "'X . As noted -in Chapter IV (See Figure 
IV- 1) in the body of the report and as shown in Figure E-l in this appendix, 
the nesting ,;f EdExAg groups^ under different levels of a given EdExAG scale 
(because different Ed Fx AG groups could have the same score on an EdExAG scale) 
meant that criterion variation among EdExAG groups could be attributed to 
two sources — the variation among EdExAG groups within levels of the EdExAG 
variable (pooled across the various levels) and the variation among levels 
of the EdExAG variable. This among levels variance could also be partitioned 
into linear and nonlinear components. On the other hand, when the sum of 
"squares attributable to 'the linear component was divided by the total sum 
of squares, the resulting index is the. square of the cr i ter ion /EdExAG 

variable correlation. Part of the difference between R 2 (D ) and r 2 then 

• i yx ' 

could be due to the fact that different EdExAG groups had the same xj score, 
but not the same mean criterion score (Y . ) . 

Examination of ^igure E-3 shows a case where the group means with 
inspect to the criterion variable (Y ) are not equal even though the two 
groups had the same level (i..e. |f groups 1 and 2). As noted in Chapter IV, 
however, an analysis of variance in which the total variation in the 
criterion variable is partitioned into variation among levels of variable 
X x and within levels of variable X ] would permit the assessment of non- 
linear effects. 'A variance ratio computed. by dividing the sum of squares 
attributable to difference among l evels by the total sum of squares would 
express the proportion of criterion variance attributable only to linear 

• ind nonlinear -components of the Y, X relationship. Comparing this ratio 

2 ' 
with r vx r COuld then bo used to oxamine the extent to which the criterion 

vnr fable /EdExAG variable relationship deviated from linearity. 
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'•1 , 3 and A , 

= regression line (it there are unequal 
numbers of students in the groups, the 
placement of the regression line will 
■■: be influenced more by the group wirh 

the larger n's) . • * 

Figure K-J. Example of the regression of a student-level variable 
or a group-level variable. 

Including one or more quantitative EdExAO 1 evel predictor variables in 
a prediction equation with oae or more student- love] variables is similar to 
using a vector of Y . scores in a multi-level i.:odel. Correlations of student- 
^J/eve\ variables with the EdExAC-level variables will be based on among-group 
covariau.on (.see equation E-39), that will reflect only a linear trend com- 
ponent. For. this reason, commonality-analyses of '.he multi-level pre- 
dictor n.odels containing the quantitative EdExAG variable, will, in esse ice, 
involve the assumption that only linear confounding of the student-level, 
predictors with the EdExAG variable is of interest; and, that only linear 
relationships between the EdExAG scale(s) and" Cho criterion will be 
examined. 
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F. Signif icance Te ats i L th EdExAG-Leve 1 , Variables 

As discussed in Chapter IV of the report, the' manner in wi.u.h EdhxAG 

groups wore nested under levels of ti given EdExAO scale (see Figure K ~ 1 ir 

this appendix) implied that the .nose appropriate .star isr ira I test for the 
correlation between a student-fe /e 1. variable and an F.dEXAG seal.- was an 
F test for linear trend: 

2 

Y ... . % (K-AO) 

( l -Vd : )/ (N - k > 

where, 

2 ' 
r vx " the square of the correlation between a'student- 

1 level variable Y and an KdF.xAG- level variable Xj ; • 

2 

R v-d = Che sc l uare of Cne multiple correlation between Y 

i and a series of dummy codes which encode membership 
in one of k FdExAC. groups; . 

N = the total number of students; and 

k = the number of Ed Ex AC. groups. 

The estimate of random error in the denominator includes only wi t Inn-KdExAG 
group variance. The^ degrees of freedom for this rest are j and (N - k) 

The correlation among EdExAG-level variables themselves- also requires 
some discussion. It should be remembered that although a given analysis 
data Get may concaii. as many as 2,000 students, the number of different 
Ed Ex AG groups in which these students were located was considerably smaller. 
For this reason, the proper degrees of freedom for a r test of rhe correla- 
tion between two EdExAG-leve 1 variables weald not necessarily be (N - 2) 
where N = the total number of students. Examination of the wi th in-groups 
and among-groups composition of such a correlation (see Equation E-20) shows 
that if variable and variable X 2 are both EdFxAO-1 evel scores, all 
wiLhin-grcup covariance anc^ variance components to the correlation will be 
equal to zero. In fact, if X 1 and X 2 had be \ used in Equation E-20. it 
would have reduced to: 
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r 

\ , x 



i-L . 




£«i (X l. " X , )2 /f - X,) 

/i ! 1 " 



1=1 



k / k 

1 = 1 v 



i-1 



• where, 

X l. = x i. = tne scoru tor lidExAd group i on I-dKxAC sralc I; 
X 2. ~ X 2 i = the scoro for EdExAG group i on KdExAC. scale 2; 

n- = theVaimber of students in group i; and 
k = the number of EdKxAG groups. 

This equation shows that the correlation between two EdE>:AC^! eve 1 variables 
computed over all students . is nothing more Mean a correlation" bnst-d upon k 
observations in which each pair of oDservat ions on the ith group is weighted 
t>;/ the number of students in thai group. And, since each observation or 
pair of observations does not contribute equally to the variances and 
covariance in liquation K-41, the appropriate 'degrees of freedom for KdKxAG 
variable correlations is not merely the number of groups (k) minus 2. 
Rather, it is necessary to consider the effect that differential weighting' 
of certain scores has had. A somewhat more appropriate approximation to 
the determination of the degrees of freedom for KdExAG- 1 eve 1 i n t e rcor r e 1 a t i ons 
is provided by the "effective sample size." (Wilson and Wise, 1975 , p. l)-4) 

The effective sample size, k £ .ff t is defined to bo the estimated number 
of equally weighted cases needed to achieve the level of accuracy obtained 
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by differential weighting of cases, • t* "accuracy" is measured by the 
standard orror of the mean, c- , the accuracy of a mean of k weighted 
observations would be 




the standard error of the mean of variable X'; 
the population standard deviation; and 
ch e e f f ec. t ive samp I e size. 



wh ere, 

x 
x 

Kit = 



Sq 



uaring Kcj nation K-42 and solving for U cc leave 

^ eft. 



ef f 



'K-4 3) 



i iowevcr , 



w i x i 



(K-44) 



whe re 



rh 



the we i glit assigned to the i scon* (here, i: 
equal to the number of students in the i t h 
HdExAC; gro - 



fcince -.--J- is a constant, 



7; ' k ^ '"'CWiXi) 



\ i=l 



(K-4 5) 



25 i 
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In other words, the variance of the moan of weighted X scores is equal 
to the variance of the sum of the weighted scores divided by the squared 
sum of the weights. 

if it is then, assumed that each U' . X - is independent ui every other 
W.,a^ and that weight W. is invariant for group i, Kquation K-41 becomes 



• _ 1 k 

Assuming that the population variances of X. for all i strata are 

i 

equal and further assuming that the yo i gh t s , W , are invariant ;< reasonable 
assumption in this instance), Kquation K-4h reduces to 

2 i=l • 
o- - — • - • (K-47J 



1 ( 

V i=l 



£4 



Substituting Kquatiop !■>',/ into Kquation I>m i and serving for k |- j- leaves, 

S 

If it is then assumed that - , Kquat ion K-4fc becomes, ' 



ef 



( !■■- 'an 

Em 2 '' '• 



in a 



It-should tu; noted, however, that V.<\iiAlion K--V) undoubtedly results 
^wVr-boi.nd estimate of . the effective sample si,, - , hl , ri . ;l . son {u , ini , t!i;lt 

£ 0 ) 
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^ will almost certainly be larger than o,f S o the ratio, ^/-^ , dropped 
from Equation E-48 is in reality greater than 1.0. Therefore , *jhe effective 
sample size is somewhat greater than. the sum of the weights squared divided 
by the sum of the squared weights. 

In Project LONGSTEP the weights, W. , are the number of students (n.) in 
the k different EdExAG groups. The :v,mberof degrees. of freedom used for 
the t test of a given correlation among two EdExAg scales, then, is equal, 
to k eff - 2, Again, it should be noted that k eff is onlv an approximation. 
First, the assumptions required in the derivation are not entirely appro- 
priate given the particular structure of the LONGSTEP- Ed ExAG- level data. 
Second, the definition- of k Qff vas based upon the standard error of the mean 
and not the sampling error of a Pearson r. Since the effective sample 
size for EdExAG- level correlations (k^ ff ) will usual Iv -e less than the 
actual number of EdExAG groups (k), the use of l^ ff in the determination 
of the degrees of freedom for a particular correl at ion" means that the sig- 
nificance 'test of that r will be conservative. 
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ainber of StiuU..i';, Sc hoo 1 s and 
K ( 1 li :•: AC t -r , > up s per Site 
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TABLE 1 



Number of Students, Schools and EdExAG Groups per Site - 
Cohort 1, Spring .1972, Reading Total Score Analysis 



Siti 



Numbe r of 
Schools 



Numbe r o f 
EdExAG Groups 



Number of Students 



12 ( h ~ 7:3) 



3 
4 

h 
7 
8 
9 
10 
11. 
12 
1 J 



78 ( Ti - 
72 

2 11 (101- 

l^K ( 2 - 



i '')) 
88) 



The minimum and maximum number of students in these EdExAG 
groups are shown in parentheses if more than one &».roup is 
present in a site. 



TABLE 2 

Number of Students, Schools and EdExAG Groups per Site - 
Cohort 1, Spring 1973, Reading Total Score Analysis 



Site 


Number of 
Schools 


Number of 
EdExAG Groups 


Number 


* 

of Sc uden t s 


1 










2 

3 
4 


_ 


4 


194 


( 3.1 - t)2) 


6 
7 










8 










9 


2 


3 


80 


( 17 - 40) 


10 










11 


1 


1 




85 


12 


2 


2 


219 


(107 - 112) 


1 ~ 


4 


7 


.189 


( 7 - 78) 



The minimum and maximum number of students in these EdExAfl 
groups are shown in parentheses If more than one group is 
present in a site. 
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TABLE 3 



Number of Students, Schools, and EdExAG Groups per Site 
Cohort 4, Spring 1972, Reading Total Score Analysis 



Number of Number of " * 

hlt ° Schools EdExAG Groups ■ Numb er of Studen 1 « 



1 


1 


8 


284 


( 14 - 


58) 


2 


4 


5 


268 


( 21 - 


86) 


3 


1 


1 




•) *> 0 




4 


1 


1 




26 




5 


2 


2 


40 


( 17 - 


2 3) 


h 


4 


5 


114 


( H - 


47) 


7 


3 


3 


128 


( 41 - 


46) 


8 


1 


1 




29 




o 


2 


o 


98 


( 45 - 


5 3) 


LO 




2 


155 


( 33 - 


122) 


11 


n 




153 


( 63 - 


90) 


12 






233 


(116 - 


117) 


L3 


4 


8 


202 


(' 12 - 


86) 



*. 

Th e mini mum an d ma x i mum n umb e r of shi do n t s i a I h e s e E d E :•: AC 1 
groups are. shown in parentheses if more than one group is 
present in a site. 
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TABLE 4 



Number of Students, Schools and EdExAG Groups per Site - 
Cohort 4, Spring 1973, Reading Total Score Analysis 



q . Number, of .Number of „ , ' * 

SltG Schools EdExAG Groups Number ° f ^udents 



1 


7 


7 


275 


( 13 - 


65) 


? 


4 


4 


213 


( 20 - 


68) 


3 


1 


1 




259 




4 


1 


. 1 




28 




5 


2 


2 


38 


( 19 - 


19) 


6 


4 


4 


117 


( 7 - 


59) 


7 


3 


4 


149 


( 23 - 


54) 


8 


1 


1 




32 




9 


2 


3 


112 


( 25 - 


60) 


10 


2 


2 


140 


( 50 - 


90) 


11 


2 


3 


180 


( 5 - 


102) 


12 


1 


6 


20 7 


( 29 - 


39) 


13 


4 


6 


175 


( 13 - 


78) 



The minimum and maximum number of students in these EdExAG 
groups are shown in parentheses if more than one ^roup is 
present in a site. 



TABLE 5 



Number of Students, Schools and EdExAG Groups per Site - 
Cohort 6, Spring 1972, Reading Total Score Analysis 



Number of Number of 

-Schools E d Ex AG Grou ps Number ° f s f"^nt s 

1 1 2 A '30 (110 - 320) 

9 



32 



3 1 1 
4 
5 

7 ■ 1 1 

8 

9 1 1 93/. 

10 ' 1 1 110 

11 ; - - 

12 1 2 . 191 ( ^ - 105 \ 
n 1 3 165 ( 50 - 61) 



158 



The minimum and maximum number ?i students in these EdExAG 
larrups are shnvrn in parentheses ii more Lha:. one ;;roup is 
■ err nt in .1 .• - : u . 
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TABLE 6 



Number of Students, Schools and EdExAG Groups per Site - 
Cohort 6, Spring 1973, Reading Total Score Analyses 



Si Number of Number of ' i 

Schools EdExAG Groups Nu?nber of Stud ^nts 



* 



13 • 1 o 



* 389 



237 



1 1 1 
2 

3 1 1 

4 

c 5 - 

6 - 

7 1 1 

8 - _ 

9 1 1 236 

i° 1.1 125 

11 - 

12 1 6 267 ( 41 - 48) 



162 



L 36 ( -33 - 10 3) 



The minimum and maximum number of students in these EdExAG 
groups are shown in parentheses if more than one group is 
present in a site. 



TABLE 7 



Number of Students, Schools and EdExAG Groups per Site 
Cohort 1, Spring 1972, Language Total Score Analysis 



o • . Number of Number of „ , * 

SU C Schools EdExAG Groups Number ° f St udent s 



:32 ( 6 - 73) 



1 






9 


A 


6 


3 






4 






5 






6 






7 






8 






9 


2 




10 






11 


1 


i 


12 


2 


2 


] 3 


4 


7 



78 ( .35 - 4 3) 
67 

213 (103 - 110) 

19 7 ( 2 - 88) 



The minimum and maximum number of students Ln thesi- EdExA(* 
groups are shown in parentheses if more than one ^roup is 
present in a site. 



TABLE 8 



Number of Students, Schools and EdExAG Groups per Site - 
Cohort 1, Spring 1973, Language Total Score Analysis 





Site 


Number of - 
Schools 


Number of 
EdExAG Group 


Number 

s 


of Students 


1 


- 


_ 






- 


2 
3 
4 


4 


4 




192 


( 31 - 61) 


- 


- 






- 


5 
6 










: • 


7 
8 












9 


2 


3 




80 


( 17 - 40) 


10 












11 


1 


1 






80 


12 


2 


2 




220 


(107 - 113) 


13 




7 




183 


( 5 - 78) 




The minimum and maximum number 


of 


students in 


these EdExAG 


groups 


are shown in 


paren these 


s if 


more than one group is 


p resent 


in a site. 











I V-K-8 

2 (id 



TABLE 9 



Number of Students, Schools and EdExAC Groups per Sire - 
Cohort 4, Spring 1972, Language Total Score Analysis 



Number of Number of 
Schools E dExAG Groups Niw*^ 0 f St - ude n c s 



1 


7 


8 


292 


( 


14 - 


59) 


2 


4 


5 


273 


( 


22 - 


88) 


3 


1 


1 




222 




4 


1 . 


1 






27 




5 




2 


40 


( 


17 - 


23) 


6 


. 4 


5 


116 


( 


8 - 


49) 


7 


• 3 


3 


131 


( . 


.42 - 


4 7) 


3 


1 


1 






U 




9 


2 




104 


( 


50 - 


54) 


10 


2 


0 


154 


( 


33 - 


121) 


11 


2 


2 


158 


( 


66 - 


92) 


12 


2 


n 


242 


(1 


20 - 


1.22) 


13 


4 


8 


205 


( 


12 - 


88) 



The minimum and maximum number of students in these EdExAG 
groups are shown in parentheses if more than one i»roup is 
prese j in a slue. 



TABLE 10 



Number of Students, Schools and EdExAG Groups per Site- - 
Cohort 4, Spring 19 73, Language Total Score Analysis 



Site Number of Number of * 
Schools EdExAG Groups Number of Students 



-1 

1 


7 


7 


274 


( 12 - 


65) 


'• -> 


4 


4 


213 


( 19 - 


68) 


3 


1 


1 




253 




4 


1 


1 




28 




5 


2 


, 2 


37 


( 18 - 


19) 


6 


4 


4 


117 


( 7 - 


59) 


7 


3 


4 


148 


( 23 - 


53) 


8 


1 


1 




32 




9 


2 


3 


113 


( 25 - 


61) 


10 


2 


2 


._136 


( 47 - 


89) 


11 


2 


3 


175 


( 5 - 


100) 


12 


1 


6 


207 


( 29 - 


39) 


13 


4 -- 


6 


169 


( 13 - 


75) 



The minimun and maximum number of students in those EdExAG 
groups are -;nown in parentheses if more than one group is 
present in a site. 



i 



1V-F-I0 



TABLE 11 



Number of Students, Schools and EdExAG Groups per Sire - 
Cohort 6, Spring 19 72, Language Total Score Analysis 



c .. Number of Number of Kt , 

^ite c k ~i cjr. n ' Number ni Student! 

Schools EdExAG ( .roups ^ 



4 30 (111 319) 



228 



n - - - 

7 L " j . | H • 

H 

9 1 1 227 

10 1 1 L03 
11 

12 1 2 186 L 84 - 102) 

13 1 3 . 136 / 47 - 57) 



The minimum and maximum number of students in these EdExAG 
groups are shown in parentlu sr .-; i more than one i*,roup is 
present in a site. 



TABLE 12 



Number o.f. Students , Schools and EdExAC Groups per Site - 
Cohort 6, Spring 1973, Language Total Score Analysis 



c • . Number of Number oi ' * 

blte Schools, EdExA C. G roups Numbe r of Students _ 

1 1 1 375 

2 

3 1 1 .211 



D — 

6 

7 1 ' 1 

8 - _ 

9 • 1 i 2 38 



165 



10 1 1 125 

11 - - _ 

12 1 6 266 ( 42 - 4 7) 
1'3 1 • 2 127 ( 2 7 - LOn) 



The minimum and maxir .i,u number of students in these EdExAC 
groups are shown in parentheses if mure than one fcroup is 
present in a site. 



TABLE 13 



Number of Students, Schools and Ed Ex AG Groups per Site 
Cohort 1, Spring 1972, Arithmetic Total Score Analysis 



c . V.'-^er of Number of 

)U ' .u nft i , nin vAr r , N uml^er of Students 
en *-}£_lJ$ Ld LxAG Group s 



127 ( 3 - 12 ) 



9 2 2 76 ( 33 - 43) 

in 

n . l i 67 

1 '2 2 191 ( 88 - 10 3) 

1 '* 4 7 i 91 ( 2 - H 5 ) 



9 

■k 

The minimum and maximum number of students in these EdExAG 
groups are shown in parentheses ii mure than one group is 
present in a site. 



2 7 t 

j V-[-- 1 5 



'FAULK 1/4 



Number of Students, Schools and EdKxAG Groups per Site - 
Cohort 1, Spring 197 1, Arithmetic Total Score Analvsis 



Numb or of Number of 
„ _.^:IL^ M^SLr^T* ;l l i m ^ el l 01 St udc * lU 



187 ( 2 K ) - uO) 



10 
M 



1 '? 



90 ( W - 



77 

1:0b ( 94 
181 ' « 



112) 

7 'J ) 



The minimum and maximum number of students in those EdKxA( 
groups' are show in parentheses if more than one :roup is 
pre sen t in a site. 



IV-r-1 . 
< ) 7 ) 



TABLE 1-5 



Number of Students, Schools and EdExAC Croups per Site - 
Cohort 4, Spring 19 72, Arithmetic Total Score Analysis 



Site 

- - 


Number of 
S choo 1 s 


Number of 
LuExAG Groups 


Ne.nbe 


r of . 


'•I uden t : 


















7 


8 


29 2 


( 14 


- 58) 




4 


5 


26 3 


( 22 


- 91) 


3 


1 


1 




219 




4 


1 


1 




27 




5 


2 


2 


42 


( 18 


- 24) 


h 




1 

/ 


114 


( 8 


- 49 ) 


7 


3 


3 


128 


( 41 


- 44) 


8 


1 


1 




30 




9 


2 




101 


( 47 


- 54) 


10 


2 


2 


150 


( 32 


- 118) 


11 


2 


2 


139 


( 58 


- 81) 


12 


2 


2 


2 36 


(117 


- 119) 


13 


4 


3 


202 


( 12 


- 86) 















The minimum and maximum number of students in these EdExAG 
groups are shown in parentheses i: more than one group is 
present in a site. 



2?'.i 



TABLE 16 



S 



Numbe r 


of Students 


; , Sc hoo 1 s and \id\i 


xA(I Groups 


pv r 


Si 


t e - 


L'ohor t 


4, Spring 

. 


19 7 3, Arit timet ic 




Total Score 




Ana 1 y 


sis 


ito 


Number » . 
Schools 


Number of 
fiilExAr. Groujvs 


Number . 


of S 


t uden t 


L 


7 


7 


2 72 ( 


1 i 






i 




4 


2 Oh ( 


20 




OH) 


'3 


1 


1 




2h 1 






■A 


1 


1 




i 7 






r ) 


) 


•) 


J9 ( 


] L i 
i * 




20) 


h 


4 




11 "3 ( 






; , i) 


7 


J 
1 


i 

1 


1 4 3 ( 


19 

32 




- "$) 


9 


> 


. J 


1.1 4 ( 


1. 




hJ) 


LO 




■? 


1.6 L ( 


49 




li.:) 


1 1 






194 ( 


9 ] 




ion 


12 


i 


7 


2 1. 1 ( 


•) i 






1 3 


•4 


h 


189 ( 


1 8 




7H) 



The minimum and maximum number ot" students in these KdKx.ACI 
groups are shown in parentheses if mere than one group is 
present in a s i t e . 



2 7 i 



TABLE L7 



Number of Students, Schools and KdExAC! Groups per Site - 
Cohort 6, Spring 19 72, Arithmetic Total Score Analysis 



Sit( 



N umb e r of 
Schools 



Number of 
Y i i ExAG (irou p s 



N umb e r of St udeu t s 



1 

2 

3 
4 
5 
h 
7 
8 
9 
10 
1 1 
12 
13 



4 30 



!4o 



154 

220 
84 ( 4 

L50 

1 39 ( 49 



80) 



55) 



The minimum and maximum number of students in these KdExACI 
groups are shown in parentheses Li more than one group is 
present in a site. 



2 7 5 

rv-K- 1 7 



TABLE 18 



Number of Students, Schools and EdExAC Groups per Site - 
Cohort 6, Spring 19 73, Arithmetic Total Score Analysis 



q - , Number of Number of 

Schools EdExAG Groups Number ° f St ^ nt ' 

1 I- 2 389 (140 - 249) 
2 

3 - 1 2 238 ( 26 - 212^ 



8 
9 
10 
11 

12 
13 



152 
224 

12 3 (36 

253 ( 29 
126 ( 12 



87) 

45) 

1 H) 



The minii 1 .."^ and maximum number of students in these EdExAG 
groups arc ,nown in parentheses if more than one group is 
present i n a site. 



fV-K-18 
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SKS and rretest ' ■ legator Analysis Results: 
U'V<>1 of Innovation and Decree of 
Individualization Hrowth Models 
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TABLE 1 



G Moderator Analyses, Level of Innovation Growth Model - 
Reading Total Score Analyses 



Cohort 


r os c ces c . 
Year 




r Lm 


] 


? 


df 


P 


1 


SP72 


.26489 


.26159 


0 


.88 


A; 781 


NS 




SP73 


£ 1 CC 1 

• Olj J 1 


.61412 


0 


.68 


4 ; 757 


NS 


4 


SP72 


. 7139 7 


. 71267 


2 . 


.21 


4; 1942 


NS 




SP73 


.73945 


. 73583 


6, 


,65 


4 : ! 9 1 5 


• .01 


6 


SP72 


. 74527 


. 74480 


0 . 


, 70 


4; 1510 


NS 




SP73 


. 75108 


. 74937 


9 


65 


4;1542 


■ .05 



TABLE 2 

SES Moderator Analyses, Degree of Individualization Growth 'Model 

Reading Total Score Analyses 



Cohort 



Post test 
Year 



FM 



RM 



df 



SP72 
SP73 ' 



26357 
60379 



.26051 
.60052 



0. 81 
3. 31 



4;781 
4;757 



NS 
.05 



SP/2 
SP7 3 



71358 
73984 



71266 
7 3 740 



1.56 
4.49 



4;1942 
4 ; 1 9 1 :> 



NS 
.01 



SP72 
SP73 



745 19 
75177 



74471 
74965 



IV-C-l 



0. 71 
3.29 



4; 1510 

4; I542~ 



NS 
.05 



1 



216 



TABLL 3 



Vetest Moderator Analyses, Level of Innovation Growth Model - 
Reading Total Score Analyses 



Conor t. 



Post test 
Year 



FM 



df 



SP72 
SP73 



, 26821 
.61569 



26159 
.61.412 



J . 77 

0 . 7 7 



4; 781 
4; 757 



NS 

NS 



SP72 
SP7 3 



71281 
73826 



71267 
7 358 3 



4.45 



4 ; 1942 
4; 19 15 



NS 
.01 



SP72 
SP73 



7^553 
75074 



74480 
74937 



1.08 
2. 12 



4; 1510 
4;1542 



NS 
NS 



TABLE 4 

Merest Moderator Analyses, Degree of Individualization Growth Model. 

Reading Total Score Analyses 



Cohort 



Post test 
Year 



FM 



df 



SP72 
SP7 3 



26658 

.M.H52 



.26051 
,60052 



1.62 
0.47 



4; 781 
4 ; 757 



6 NS 
NS 



SP72 
SP73 



71287 
7 39 72 



71266 
73740 



0. 35 
4.27 



4; 1942 
4;1915 



NS 

.of 



SP72 
SP73 



7455 1 
75096 



74471 
; 74965 



1 .19 
2.03 



4 ; 1 5 10 
4 ; 1 542 



NS 
NS 



rv-c-2 



TABLE 5 



SES Moderator Analyses, Level of Innovation Growth Model 
Language Total Score Analyses 



Goho r t 



*st test 
Year \ 



FM 



RM 



SP72 
SP73 



.250.^0 
, 645^4 



.24610 
.63742 



1.17 
4.2 1 



4 ; 777 
4; 745 



NS 
.01 



SP72 
SP73 

SP72 
SP73 



,69896 
70 701 

,648 32 
67914 



.b9472 
. 70 346 
) 

.64501 

. 6 7884 



7.00 
5 . 7 3 

3.49 
0. 35 



U ; 1985 
4; 1892 

4; 1481 
4; 149 7 



.01 

.01 

.01 

NS 



TAB Li- 6 

SES Moderator Analyses, Degree of Individualization Growth Model - 
Language Total Score Analyses 



Cohort 



Post test 
Year 



RM 



(If 



SP72 
SP73 



24926 
64535 



24460 
,6 3564 



1.21 
5.10 



4 ; 777 
4; 745 



,01 



SP72 
SP73 



,69943 
7^64 3 



69 496 
70411 



7.41 
3. 74 



; 19 85 
4 ; 1 892 



.01 
.01 



SP72 
SP73 



, ^4818 
67925 



, 64 50 3 
■ 67871 



3. 29 



4:148] 
4; 149 7 



.05 

NTS 



TV-G-'j 

2 8 0 



TABU- 7 



Protest Moderator Analyses, Level of Innovation Growth Model 
Language Total Score Analyses 



Coh o rt 



Posi.test 
Year 



fm 



KM 



df 



SP72 
SP / 3 



23 7AM 
64549 



.24610 
,6 3742 



3. on 



4 ; 7 77 
4; 74S 



.05 
.01 



SP7 3 



,69758 
■ 705 38 



.694 72 
, 70 346 



4.69 
3.08 



4; 1985 
4; 1892 



.01 

,05 



SP72 
SP73 



,64569 
. ^7908 



.64501 

,6 7884 



0. 71 
0.28 



['ABU-: 8 



4 ; 1481 
4; 149 7 



NS 



Pretest Moderator Analyses, Degree of Individualization Crnwth Model 

Language. Total Score -Analyses 



Cohort 



Post test 
Year 



FM' 



RiM 



cli 



SP72 

SP7 3 



.25545 .24460 2.83 , 4 ; 777 .05 
.64 366 .6 3564 4.19 \ 4; 745 .01 



SP72 
SP73 



,69 800 
. 705 56 



,69496 
7041 \ 



5.00 i 
2. 3 3 ; 



4;1985 
4 ; 1892 



.01 

NS 



SP72 
5P7 3 



64572 
67922 



64505 
6787 1 



0 . 70 
0 . 5 1 j 



4; 1481 
4; 1497 



NS 
NS 



rv-c 



I 



TABLS^ 9 



SES Moderator Analyses, Level of Innovation Growth Model 
Arithmetic Total Score Analyses 



Cohort Posccest 2 2 
_ . Year FM RM 



df 



SP:'2 .26280 .24319 j 4.93 4;742 -.01 

SP73 _ . 57272 .56801 2.01 4;731 NS 

sp 72 .63744 .63481 3.51 4 ; 19 33 .Ql 

SP73 .6757 7 .o72 72 4. bU 4 ; 19 54 .01 

SP72 .67573 \ 6 7404 1.87 4; 1433 NS 

sp7 ^ .742 12 . 7409S 1.65 4; 1495 MS 



TABLE 10 

SES Moderator Analyses, Degree of individualization Growth ilodel 
Arithme t ic Total Score Analvses 



Cohort- 



Post test 
Year 



RM 



df 



SP72 
SP73 



26332 
55826 



24319 
55173 



5.07 
2. 70 



4; 731 



.01 

,05 



SP72 
SP73 



■ 63712 . 6 3552 -*rT]:3 

■ t 7503 . (>7196 4 . f>2 




4; 19 33 NS 
4; 1954 " .01 



SP72 
SP7 3 



,67135 .669 77_^'] . 72 4; 1433 MS 
7429C- 74174 1 . 77 4 ; 1495 NS 



"V-G 



282 



TABLE 11 



Pretest Moderator Analyses, Level of Innovation Growth Model - 
A r i t h me t i c To t a 1 Score An a 1 y s e s 



Cohort 



Post test 
Year 



FM 



RM 



df 



SP72 
SP73 



25156 

.5 729 J 



24 319 
.36801 



2.07 
2. 10 



4; 742 
4; 711 



NS 



SP72 
SP73 



.63505 
. 0 7f)hb 



.63481 
. (i 7 2 7 2 



0. 32 
5.96 



4; 19 33 
4; 1954 



NS 
.01 



SP72 
SP73 



.6 76 37 
74223 



.6 7404 
. 74098 



2.58 
1 .96 



4; 14 33 
4; 1495 



.05 
NS 



TABLE-" 12 

Prutest Moderator Analyses, Degree of Individualization Growth Model 
Arithmetic Total Score Analyses • 



Cohort 



Post test 
Year 



FM 



RM 



df 



SP72 
SP73 



25125 
55 7 31 



.24319 
.55173 



2.00 
2. 30 



4;742 
4; 731 



NS 
NS 



SP72 
HP 7 3 



63579 

h /5 30 



.63552 
.67196 



0.36 
5 . 02 



4; 1933 
4:1954 



NS 
.01 



SP72 
SP7 3 



.672 36 
74 308 



.66977 
. 7^174 



2.8 3 
1,95 



4;. 14 33 
4; 149 5 



.05 

NS 



IV-C-6 



28;* 



APPENDIX IV-H 

Project LONCSTEP Profile Variable: 

ami Vari .\pi>r.-v iat. ion-Snmarv 



28 i 



Yojeet l.nNi 


STEP Pro: i i 


• Va r i ah 1 < ■ a;;.: V i r.i iu 1 , \hbia ■ w i a t i i mi Sic 


Variable 
Abb rev La t ion 


Var i ah 1 Labe I 


COON IT I VE 


OUTCOMES : . 


/ 


PH" 7 i 




PiT'/i'iU 'i-A 1 ot : School Year Conip I «• 1 1 m 
to I\ : t in,'., Sprhv.' I c )7 1 (SP71) 


POT 7 11 




i\'i\'i'iU;ij;i' of 'iool Year Conn 1 1 1 t 
to T. in • , Spi-ia-.: i l >72 (SP72) 


RIOT 71 




Read i nj; Tot a 1 i'o r S P 7 I 


RTOT72 




Reading Total for SP72 


RESR7 1 






RES R 72 




RTOT72 R«*s i dua I i /.t d tor Tinir o; T.'- 


R71R72 




R E S R 7 2 Residual ized for RESR71 


REXP72 




RKSR72 Ri-sidii.il i'/.ed for Protest am 


ATTITUD IN A 


L OUTCOMES : 




ATS 71 




Attitude toward School SP71 ; 


ATS i: 




At f i tude toward School SP72 


A TLA 7 1 




At r i Hide toward Language Art s S P 7 1 


ATLA/2 




Attitude toward Language Art.; SP72 


■ RI 71 




Reading Interest SP71 


Rl 72 




Read i n >; I n t erest. SI'72 


ATM 71 




Alt i tilde t uward Math SP 7 1 


ATM 7 2 




Aft L tnde toward Math SP72 


Si 71 




SoV i al I den* : tv SP71 


S 1 72 




Soe j a 1 \ den t L i v SP72 


STUDENT ATTRIBUTES: 




COMPSKS 




Compos i t o !" Stud. ait ' s SES 


ET11 




l i Ri l ii l rj i . l 1 1 n 1 1 . t ) } ( > u j j i u =■ nonwii 1 I 


SEX 




'ifiwii'Tit ' S i" > v ( ( i * " pi • i 1 1 1 • i - t it-^il i 
■ > i 1 1 ut 1 1 i ,i >u /, v ( j Li. \ j ( , j - I (.'hi, Me 


EdExAC VAR 


IAHLES : 




e:m;o 




Ut ij i ;;a t i on oi ( >b j ee t i vi 1 s ■ 


E2KITC 




Ext erna I 1 n f I nonce oe Treat :;ien J > -h. ■ 






ist ie^ 
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Variable 

Ab b r e v i a c i on 



Variable Label 



EdExAG VARIABLES (cont.) 



E2SME Staff and Materials Evaluation 

E2TE Treatment Evaluation 

E2RT Resistance to Treatment 

E2SSS School Support Staff 
l j 

121 DM Individual ization in Decision Making > 

E2TLDM Teacher or Locally Deve loped Ma t e r i a 1 s 

E21 IP Individualization of Instructional Pace 

E2UST Use of Students in Treatment 

E2UTE Utilization oi Treat men' Fvaluai ion 

E2UCI- U.st 1 nf Community Resources 

E 2SC Scheduling Charac teristics 

E2UE1 Use of External Incentives 

E2UPA Use of Performance Agreements 

E2CU0 Classroom Gro u p Organization 

E2SCD School-Classroou Design 

E2TUC Teaching Unit Composition 

E;\STI Status of Treatment lmplemen ta t ion 

E2CTP Completeness of Instructional P ackage 

E2TIST Teacher In-Service Training 

E2AL Accessibility of Library 

E2UMC Use of Media Center 

E2USE Utilization of S tu dent Eval uat ior . 

i ■'. 2 A K Affective* Ev a 1 u a t i o n 

E2MFR Mechanism for Reinforcement 

E20FP Opportunity for Practice 

E2SUM10 (and LI) Level of Innovation — Sum of the 10 

key innovat ion* sea] es 

I .!S ; 'Mi ) '. ( and 1)1) Degree o f Individual izaL ion -- Sum o f 

t he '* i nd i v Ldua 1 I za t i on sea 1 es 



1 8 o 



Variable . , , : x , 

Abbreviation 



TREATMENT AND STAFF EXPOSURE .VARIABLES: 

E2NDAYY Number of School Days Per Year 

E2NMIN ✓ Number of Minutes Per Day 

E2SCHW % . Number of Student Contact Hours Per'..V''l' 

E2TSCHR Teacher/Student Contact Hour Ratio 

E2ASCHR Paid Ai.de/SLuJent Contact Hour Ratio 

E2VSCHR Volunteer/Student Contact Hour Ratio 

E2HSCHR Student Helper/Student Contact Hour Ratio 

.vTLASSROOM OBSERVATION VARIABLES: 

/ 

C 2 U~M / Use of Materials 

C2CE Classroom Environment 

C2SA Study Arrangements 



AR * Access to Resources 



TEACHER VARIABLES 

T2NTCHRS \ Number of Teachers 

T2AGE ■ '' Teacher 1 s Age 

T2TSH Teacher's Socioeconomic Background 

T2T0 Teaching Qualifications 

T2CPR Current Professional Reading"' 

T2TAUP Teachers Associations or Union Participation 

T2SK School Reputation » u 

T2AS Ad mini st rat ive Support 



^he variables and variable abbreviations listed are for the. Spring, 
1972 post test analysis (SP72) oi the Reading Total score. The M E2" 
which precedes the EdExAG vn i Me abbreviations, the t, T2 t, which precede 
the teacher variable ah' relations, and the n C2 M which precedes the 
classroom observation mec: ures identify the data collection year as 
Yi ar 2, 19 71-72 . 

Underlined are the key measures of innovation — that is, the t»-n 
scales forming the super index, Level of Innovation. 

*^Primar\ me lsure ui individualization — that is., one of four scales 
form in u the super index, Degree of Individ tin 1 izat ion. 

I V-l!- \ 
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APPENDIX V-A 

Post test/Norm and Pretest/Norm Comparisons - 
Read ing Tota 1 Score Analyses 
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TAliU- V-A- I 



Posttes t/Norm and Pretest/ Norm Comparisons - 
" Reading Total Score -Analyses 



Cohort. 1 Cohort 4 " Cohort "h 
- - - SZZJL_ .Sm SP72 SJ72 _ SP72 SP73 

Post test Mean/ 

Norm Difference 1 18,48 25 ~ 16 12 • 51 16.90 5.27 9 . 9 3 

Post test Difference 

Ratio- - 29 -22 .07 .12 

Pretest Mean/ 

Norm Difference 1 - * lf, ' % 18:91 18- 73 22.80 19.45 

Pretest Difference 

Ratio ? * -27 • .29 .28 . : i .27 



l Norm based on 50th percentile for spring -testing. ' 



X - Norm 

post test 

SI) " ' " 

pos t tes t 



X - Nc 

pretest 



SD 

pre t e^ 



CTMM was used. 



/ 



V-A-l 
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APPENDIX V-B . 

Maximum Possible Posttest and Pretest Mean Shifts 
Attributable to Test Topout Effects - - 
Reading Total. Score AnaLyscs 
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TABLE V-B-l 

> 

Maximum Possible Posttest any Pretest Mean Shifts 
Attributable- to Test Top.out '.Effects - 
Reading Total S-core^Analyses 



: V 

Cohort, Analysi s Sampl e 

Analysis t v 
Samp 1 < 



I | "posttest 



i 



pretest 



Analysis Sample 
and Topouts' 



Mean I)i f f erence- 



Cohort 
, SP7J :+ 


u 


400 


66 


338 


46 


767 


| 400 


f>6 


338 


46 


i 767 || 




.00 




00 


Cohort 
. SP72 


4, • 


469 


51 


437. 


91 


1952 


476 


98 


442. 


25 


2006 


7 


.47 


4. 


34 


j Cohort 
. 5P73 


4,' 

i 


507. 


40 


475. 


73 


1925 


509. 


36 


477. 


83 


1.940: 


1 


.96 


■i 


10 


j Cohort 
| SP72 

l 


: 


531. 


27 


• 5,13. 

j 


30 


1520 


534. 


30 


515. 


88 


1536' 


3 


.03 


2. 


59 


i Cohort 
j SP73 ' 


h, . 
t 


563. 


43 


545. 


45 


1552 


565. 


31 


« 

547. 


40 


"1563 
i J 


1 


.88 


1 . 


9S 



l Cohort 1, SP7'2 is not included because the pretest was the CTMM and the 
posttest, the CTBS . 

'-Means shown here were computed assuming that students who topped out 
obtained the maximum pretest and posttest scores. 

^Absolute value of' the difference. . 

''No topouts in this sample. 
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AIMM-NDI-X V-C 

Coin:non;» I i Ly A'nalysi s -of SLS - 
Reading Total Score. Analyses 
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TAttl.K V-C- 1 



Commonality Analysis of-SKS — 
Cohort 1, Spring 1972, Reading Total Score Analysis 





Prut csL 


l'\ \ \- V \( ' 




(P) „. 


Dummy (lode 


l«(.X. ) 


.04208 


. 36201! 




-.01 326 


-.01326 




.00063 




e(ivr) 




.026^2 


C(P,D,T> 


-.0009 2 


-.0009 2 


r : '-(x.) 


.02854 

i 


.37470 



Teacher 
Viir ijibK':;(TJ 

.00083 



.0006 3 
.02692 

; ooo9 1 



R>(P,1),T) -.41830 



TAB LI' V-C- 2 

Commona lily Analysis of SL\S — 
Cohort. ], Spring 1973 hauling Total Score Analysis 



PreLesL - KdKxAC feaclicr" 
00 pumni^J^dcjs( I)) _ _ Var ^iab.l es(T) 

U(X.) .OA 142 .26155 / .00386 

C(P,D) .09039 * .09039 

C(P,T) -.00105 " 1 -.00 1.0 r . 

C(0,T) . • * .03960 .03960 

C(l\D/D .03338 .03338 * .03338 

R 2 (>'.) ' .1641.4 .42493 ' , .07380 



R 2 (PJ),T) •' .46916 



2 9.i 
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' t . TABLE - V-C-3 f • 

Commonality Analysis of SES — 
Cohort 4', Spring 1972, Reading Tota] Score Analysis 



U(X.) 
C(P,D) 
C(P,T) 
C(D,T) 



R~(X_) 
1 



r) 



Pretest 
JP).„ 

^ .02458' 
'.08403 
.000 79 



.006 39 

.1 - . v 



11579 



EdExAG , . 
Du mmy Code^(D ) 

. 38609 , 
■ .08403 ■ 



.04000 
.00639 

.51652 



Teacher 
Variables(T) 

.00066 



.00079 
.04000 
.00639 

.04785 



R- (P,D,T) = .54255 



TABLE V-Ct4 t 

0 Commonality Analysis of SES : — 
Cohort 4, Spring 197 ^ Reading Total Score Analysis 



\ 



U(X.) 
1 

c(P,b) 

C(P-.T) 
C(D,T) 
C(P,D,T) 



R 2 (X.) 
i 



Pretest 

.02626 
.08349 
.00044' 

-.0306.2 
.14082 



' EdExAG ' . 
Dummy Codes (D) 

1 ■ ■■- .31398 . 
.08349 : 



.08126 
,03062 



Teacher 
Variables(T) 



,50935 



R (P,I),T) = .53639 



\ 000 34 

.00044 
.08126 
: 0 3062 

.11266 
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TABLE V-C-3 

r 

Commonality Analysis of SES — " 
Cohort 6i Spring 1972, "Reading.. Total Score -analysis 



U(X.) 

• c(pVd) 

' C(P,T) 
CCD, T) 
C(P,D,T) 



Pretest 
.0361.4 



NO 3848 



.00042 



.0 27 37 



EdExAf; . Teacher 

IHinimy ._Codcs(p) Varjab 1 es(t) 

. .17901 . * 



.0 3848 

.059 1.1 
.02737 



.00004 

.0004 2 
'.059 i i 
.02737 



JT(X. ) ■ 



1024; 



3039 7 



.08694 



K~(P,D,Ty = .34057 



Coh 



Commonality Analysis of SKS 



v^ommona i l l y .\na i ys ls o r bi-.h — 
ort 6, Spring 1973, Reading Total Score Analysis 



U(X.) 4 
C(P,D) 
C(P,T) k 
C(D,T) 
C(P,D,T) 



Pretest 



.05036 
.05066 
.0006 7 

'.02532 



R r (X,) 



1701 



Ed Ex AG 
Duir.niy Codes ( D) 



Vl9919 



.05066 

.03632 
.02332 



.3-1149 



Teache r 
Variables(T) 



.00046 

.00067 
.03632 
.02532 



.06277' 



R"0\I),T) =5 .36298 



Commona J i t v. An a I y s i s o f P re l e $ f 
Reading Total Score Analyses' 
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TABLF. V-D-l 

Commonality Analysis of Pretest — 
Cohort: 1, Spring 1972, Reading Total Score Analysis 



i:(X. ) 
i 

c:(s,m 

C( S, Y) 

a d,t) 

»'( S J), i ) 

k "(>:.) 



x . ) 
i 

S J» 
S , T ) 

S,|),T,i 



I: (X . J 
i 



.06243 
-.03394 
.00126 

-.002 1 1 



KdExAG 
Dummy Codes ( D) 



Teacher 
Variables(T) 



.02854 



.09922 
.03304 

.00372 
.0021 1 

.06 7 79 



.00365 

.00126 
.00 37 2 
.0021 L 



.00852 



ir(S,D,T) = .13712 



TABU- V-D-2 

Commonal i t y Ana lysis of P re L est "-- 
Cohort: 1, Spring 1973, Reading Total Score Analysis 



SliS(S) 
.05778 
.07954 
-.00111 

.02 794 



MExAO 
Dutnniv Codes ( D) 



1 eache r 
VariabU's(T) 



.0849 7 
. 0 79 54 

.00024 
'.02794 



.0 101 5 

.00 1 1 1 
.000 24 
.02 794 



164 



. 19 268 



.0 3722 



R-(S,I),T) - .2 39 30 



2 a / 
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VTABLE V-D-3 

Commonality Analysis of Pretest — 
Cohort 4, Spring 1972, Reading Total Score Analysis 



U(X.) 
1 

C(S,D) 
C(S,T) 
C(D,T) 
H(S,D,T) 



SES(S) 
.04 302 
.06939 
.00211 

.00J28 



EdExAG 
D u mmy Codes ( D_)_ 

.07226 
• .069 39 



-.00298 
.00128 



Teacher 
Variables (T) 

.01416 



.0021 1 
-.00298 
.00128 



K~(X.) 
i 



11579 



13994 



.0 1457 



R " ( S , D , T ) = . 1 ( *923 



TABLE V-D-4 

Commonality Analysis of Pretest — 
Cohort 4, Spring 1973, Reading Total Score Analysis 



r(x.) 

C(S,D) 
(i(S,T) 

»:(i),T) 
i:(s,ii,T) 



SES(S) 
.0440- 
.0761 L 
.00122 

.01945 



EdExAC 
On mmy Cod e s ( D ) 

.0 7381 
.07611. 



.00107 
.0194 5 



Tear her 
Va_ria_h l_es(T ) 

.00903 



.00122 
-.00107 
.01945 



R"(XJ 

L 



.14082 



16831 



.02864 



R (S f DJ) = .22260 
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^ TABLK V-I)-'. 

Commonali t y Ana Lys is nf Prrtcsf — ' 
Cohort 6, Spring 1972, Reading Total. Scor,- Analysis 



KilKxAC Toarlu-- 
Dummv CodosC D) V.ir i ah 1 es(T). 



SKS(S) 

[, (^^ .04 70} .0289 1 .00 70 5 

i:(S,D) .01192 .03192 

C:(S,T) .00094 ' .hood.; 

^(I),T) .01M4I .00 Ml 

l-(S,0,T .02252 .02252 .022 r >2 



K ( X . ) . 1024 1 .08h7fi * .0 H9 1 



T'(S,I),T) - . 14178 



TAI-'.Lr V-D-n 

I'.omniona 1 i t v Ana ! v;; i s of Prut ost -- 
Coiiori t>, Spring 1971, Kv.uliin: Tula] Scon- Anal' 



t ! (X. ) 
i 



C(S,D) 
C(S,T) 
C(L\T) 

c:(s,d,t) 



SKS(S) 
.(Hi 7^0 
.0 UwA 
. 00 1 59 

.02108 



KuKxAC 
!)u:vi:iv Coik'S ( !)) 



R"(X . ) 



2 70 1 



.00 8^5 
.0 i^7A 

■ .00002 
.02108 

.06h4h 



"IVai'lu- 
Va r i ah U>s( T ) 



.00910 

.00 1 SM 
.00002 
.0 2108 

.0 119'; 



K'"(' S ,I),T) - . i i/.94 



2;) 9 
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APPKNDIX V-K 



Intereorrelations Among All Key Analysis Variables - 
Residing Tota 1 Score Ana 1 ys< -s " ;c 



-Variable names for the abbreviations used art' ;ui in Appendix rV-H. 
Methods to be used for testing the statistical sigui. ennee of these cor- 
relations vary depending upon whether or not tin* variables were measured at 
the. s:.iident level or at the EdExAG group level. These issues are discussed 
in Chapter IV and in Appendix IV-E. 

Critical values for intereorrelations of EdExAG variable with SKS, pre- 
test and pi»sn..'St are found in Chapter V in the body of the report as are the 
critical values for correlations among tin- student level variables. Critical 
values for i n t e rco r re 1 a t i ons of Ed Ex AG- 1 evel variables with Ed Ex AG- 1 eve 1 var- 
iables are noted on each of the following tables, along with the effective 
sample size, k ^ ^_ (see Appendix I V-K) - EdExAG variable correlations exceed- 
ing the noted values are statistically significant at p .05 (two-tailed) 

with (k f ...-2) degrees of freedom, 
e i 1 
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['ABLE v-i- 



Intercorrelations among the Rev Analysis Variables 

Cohort I, Spring, 1972, Reading Total Soon Analysis 



r (p- -05) = .576, k * 13 ! 



" "t "", 
JJ wl 

;. '!: 



• j i 
- - 1 ), 



1. '.iiii; 

■•.'.J53: 
).;•;.,,, 

J.liiU 

.">:: 

J !1I5? 

■i.]i:o3 
. J 1 7 , j 

J. '17j jij 



-J 



- 1 -■ = J 3 i.cjoj.1 -\\ :.i .\ 
- 1 n d 3 2 -'i.'H).": i .ir 

.l^ 1 ' -.Ji-: :,[•;.", 



is/I? :.m:: 

117 P 



JJ-:)' J 



. 1 i 

J 5 .1 J 



7 J - • 



■v f.i, 



I 'I 1 



T i.:," 
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■ . j i, i ■ 




j.i u ; , 






- Ml." 
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TABLE V-F.-2 

Intercorrelations among the Key Analysis Variables - 
Cohort 1, Spring, 1973 Reading Total Score Analysis 

\J\ ; P <.05) = .602 , k = 11 1 



< 
i 



[0 







CORPSE.) 


1[jR»2 




^ MI'UI 


t3!j;ii'! 




*i'JO 


•3IDf! 


■iTIDM 


EJIIP 


E35C 




i A n ri (1 ft 


0,27351 


' D. 71921 


•D.1JF9S 


•fi. 113*5 




\2-lC5? 


•Mfib? 


-0.14H9 • 


0.07847 


0.06745 


-0. 24 4511 






1, DC000 


3.40515 


3,12157 


3.H382 


1,l?'i12 


.3.1fi!;5 


1.21101 


1.04J31 • 


0,19149 


0.23623 


-0.11480 


1r c ■> 1 1 

RESil/2 


. J, 71 #21 


0.1*351) 


1,03000 


3.0^ 13 


0,07585 


3.03177 
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1.00000 
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0.70321 
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0.3)339 


0.3)235 


3.3:3*, 


1,00303 


0,07305 


3.3*23: 


6.5531* 


j.i:i;.i 


1.9731} 


1.30533 


0.112*3 


-0.32*13 


-1.17121 


1.3*232 


3.112*3 


1.0003, 


0.70*12 


3.51322 


3.5331* 


-1. 02*12 


3.71*12 


1 . 03 3 11 


i ' ?!i (1 


3.129SH 


-0.17921 


0.5J335 


0.6761: 


M00J0 


■3.23373 


3,1276* 


9,1*223 


0.0*122 


-0.1150* 


-1.1 F*1* 


0.26331 


-0,13317 


6/37)1 


) V 1'53) 


i.l'J71! 


u 122.2 


5,53303 


9.732- 


J.3.,H7 


1.617.1 


•1, 360.1 


1.33*33 


9.713::; 


j . 5 2 3 ) 2 


l.l'iiJI 


3.11329 


0.023':; 


0,3,7** 


r i ■» » ■ ■ 
U . t i - J ) 



* 3 A G [ 


2 'T"1 




::/3 


PCT73 


I1I3T72 


RTOT73 


";.lWui 


0.1701'. 




or.;:: 


3.U0700 


5.3G150 


0,9901* 


J.I3JM 


0.57533 


-0 


10552 


0.2*31* 


3,356*1 


0.37*56 


7-. 1573S 


).<V1*' 






1.1025S 


0.19993 


0.66560 


;.032J1 


0.121, < 


1 


h2^l* 


3.32016 


0.11*31 


0.16W* 




Ul^l 




'j p 017 


C 82262 


0.1001G 


0,15028 




-9.1:0:2 


2 


31*2) 


5.21559 


-0,17*00 


•0.17795 


;/:j52 


•i,:;33, 




033 3 , 


-5.13736 


•0.HS71 


-0,1523* 


-.13096 


\L'15 




3 5 3'i 1 


1,72611 


0, 12 76u 


0,17599 


:. 1:111 


5. 1 7 3 2'' 


) 


52112 


j.6j*** 


0.CS65* 


0.12**9 


2,22021 


■I.V2W 


0 


2155* 


.'.31711 


•1.03384 


•0, 0531 3 


2,13325 


l/'/.l'j 






2.71201 


-fi,r031G 


3.03*31 


2. 1*56* 


.1.2.» 7 2 


i 


Ji .1 J 


j. 11 ■ 50 


3,15*55 


f. 19 75 7 


0.3337; 


-■'..i;.2, 




nni 


'.',1769 


1.1*622 


5.182*7 


3.1275* 


3.2G'"3 


1 


f| i ^ - 1 


- 05011 


3.31161 


2. 03877 


1.0*225 


-3.2T17 


j 


53J12 


'..33*51 


2 02335 


0. 0763 5 


0.1-1122 


).9371! 




72?*' 


J. 713f5 


j.057** 


3.01171 


2.133 






^ 1.7 


2 . 62 31 3 


0,10255 


■'.1*235 


1,1312: 


*M7ui* 




n )7,5 


-1.1*201, 


-1.132*5 


•0,1679* 


2.176,": 


1.1]'!01 






-3.5,1?* 


•3.0105* 


\06CE0 


\ ))7 2 


•1,05.2* 


1 


■I'ij'j'i. 


3.65;1* 


■c.,i;.u 


-G.O0032 




-C/M2* 


j 


553)* 


lino i3 


0.0-J535 


C.U702 


;.:52*3 


\ fi 35* 


- j 


C1311 


1 03555 


l.CQOOC 


C.SCi51 
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INSTRUCTIONS FOR REM) INC COMMONALITY ANALYSIS TAKI.KS 



A toehn i ca 1 1 y ijr!rnli j d (! j sniss i on of commonality ana I vs is and its 
use with multilevel predictor variables such as those analyzed !>v Project 
LONCSTKP may bo found in Appendix IV-K. The paragraphs wh i eh follow 
provide an ov rview of how the commonality analysis tables preseiUed in 
the report and in its associated appendices may he read. 

The table on the following page is a copy of one of the tables con- 
tained in the report and will, be used here- for discussion purposes. In 
brief, (1) each column in a commonality table shows the first-order com- 
monality coefficients or uniquenesses |C(X.)] and the h iglu r-order common- 
ality coe f f i c ients (e. v C(S,P)| for the predutor variable noted at tin- 
top ol the column, (2) the uniquenesses mav be interpreted as the propor- 
tion of posttest variance that can be attributed to a prfe^iietor variable 
(noted at the top of each column), after that predictor variable has been 
residual ized on the basis of all the other predictors in ffiV'ana I vs i s , ain 
(3) the commonality coefficients in each column provide a relative index 
of the predictive overlap of the predictors shown along the left margin. 
Thus, C(S,P), the second-order commonality coefficient for SLS and pretest 
measures the predictive overlap of SLS and pretest. On the other hand, 
the third-order commonality coefficient, C(S,P,K), indexes the amount of 
overlap of SKS, pretest and the LdLxAC variable set composed of Level of 
Tnnov.it ion and Number of Minutes per Dav . 

Uniquenesses usually vary from predictor set to predictor set. The 
h i gher- order common v coefficients, however, can be associated with 
all ot the variables .-.nose predictive overlap is indexed by a given eoeffi 
dent [e.g., the value for the C(S,P) coefficient is in both the SKS 
column and the Pretest column]. Coefficients have been repeated in more 
than one column so that the uniquenesses and commonalities for a given 
predictor in this model can be examined hv looking down a column. 

Normalized coefficients, that is, each c.oe f f i c i en t divided by tin- 
to' a 1 multiple cur re 1 at ion , are also shown in these table.; (b.-Iew each 
coci I ioient and in parentheses). Because this procedure expresses each 
coefiioient in terms of the overall predictability of the model |i.e., tin 

V- K- 1 
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Commonality Coefficients* for the Level of Innovation Growth Model — 
Cohort 1, Spring 1972, Reading Total Score Analysis 





Commonal i ty 
Coef f icient 


SES(S) 


Pretest 

(p) 


EdExAG 

Variables 

LI and NMIN(E)** 


Teaching 
Qualifi- 
cations (T) 





( 


.11356 
.43409) 




.09510 

.36354) 


(. 


.00423 
.01616) 


( 


.00213 
.00814) 


C(S,P) 


( 


.04454 
.17027) 


(, 


.04454 
.17027) 










C(S,E) 


( 


.00978 
.03737) 






( 


.00978 
.03737) 






C(S,T) 


(-, 


.00213 
.00814) 










(- 


.00213 
.00814) 


C(P,E) 






(• 


.00356 
.C1362) 




.00356 
.01362) 






C(P,T) 






(- 


.00051 
.00197) 






(- 


.00051 
.00197) 


C(E,T) 










(■- 


.00022 
.00083) 


(- 


.00022 
.00083) 


C(S,P,E) 


(- 


.00243 
.00928) 


(- 


.00243 
.00928) 


(-, 


.00243 
.00928) 






C(S,P,T) 


( 


.00077 
.00293) 


(■ 


.00077 
.00293) 






( 


.00077 
.00293) 


C(S,E,T) 


( 


.00024 
.00094) 






( 


.00024 
.00094) 


( 


.00024 
.00094) 


C(P,E,T) 






( 


.00014 
.00055) 


( 


.00014 
.00055) 


( 


.00014 
.00055) 


C(S,P,E,T 


(- 


.00004 
.00016) 


(- 


.00004 
.00016) 


(- 


.00004 
.00016) 


(- 


.00004 
.00016) 


R 2 (X.) 




.16429 




.13400 




.00814 




.0003R 



R 2 (S,P,E,T) = .26159 
R 2 (S,P,D,T) + = .32731 

*Below each commonality coefficient and in parentheses is the normalized 

coefficient; that is, the commonality coefficient divided by R 2 (S ,F , E,T) . 
**LI and NMIN are abbreviations for Level of Innovation and Number of 
Minutes per Day. 

+ The multiple correlation squared of posttest with SES , ptctest, the dunm 
variables encoding EdExAG c rcu P membership and the three key teacher 
variables . 

v-i*-:: 
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total proportion of post test variance explained or (S , 1\ K ,T) ] , norma I [zed 
coefficients sum to 1.0 and permit commonality coefficients from different 
analyses to be compared with respect to their relative associations in 
their own analyses. 
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TABLE V-C- I 

Commonality Coefficients* for Lho Decree of Individualization Crowth Model 
Cohort 1, Spring i c > 7 2 , Reading Total Score Analysis 



Commonality SES(S) 
Cocf f ic ien t 



U(X.) 
i 



C(S,P) 

C(S,E) 

C(S/I) 

C(I\E) 

C(P,T) 

C(E,T) 

C(S,I\E) 

C(S f P,T) 

c(s,i:,t) 
c:(i\e,t) 

C(S,I\E,T) 



R""(X.) 



. 1 1637 
(.44672) 

.04361 
(.16739) 

.00696 
(.02671) 

-.00250 
(- .00960) 



-.00149 
(-.00373) 

.00091 
( .00350) 

.00062 
(.00236) 



-.00019 
(-.00072) 



.16429 



Pretest 
(P) 

.09426 
(.36182) 

.04361 
( . 1 6 7 39 ( 



-.00272 
(-.01046) 

-.00084 
(-.00322) 



-.00149 
(-.00573) 

.00091 
(.00350) 



.0004 7 
COOL 79) 

-.00019 
(-.00072) 

. I 3400 



EdExA^ Teaching 
Van* ables Oua 1 i f i - 

Dl and MM I N ( E ) * * c a t ions (T) 



.00314 
(.01207) 



.00696 
(.02671.) 



-.00272 
(-.01046) 



-.00065 
(-.00249) 

-.00149 
(-.00573) 



.00062 
(.002 36) 

.0004 7 
(.001 79) 

-.00019 
(-.000 72) 



.00256 
( .00984) 



.0061 3 



-.002 50 
(-.00960) 



-.00084 
(-.00322) 

-.0006 5 
(-.00249) 



.00091 
(.00350) 

.00062 
(.00236) 

.0004 7 
. (.001 79) 

,0001 9 
(-.00072) 

.000 38 



ir.(s,p,i;;/r) = .26051 

jT(S,P,!Vl) + = .32731 



* Below each commonality coefficient and in parentheses is the normalized 
coefficient; that is, the commonality coefficient divided by II (S P [■; T) 

** n] nnd N>nN ^ irc> abbreviations for He^r.-i- of Ind i v i dna 1 i vii \ ion .a nd \umber " 
o* JlinulL's per Day. 

+ The multiple correlation squared of posttost with SKS, pretest, the dummy 
variables encoding EdExA^i j;roup membership and the three key teacher 
variables. 



TABLE V-C-2 

9 

Commonality Coefficients* for the Degree of Individualization Growth Model- 



Cohort 

\ 


1, 


Sprint; 


1 973 , 


Re ad i n g To t a 1 S ro re ^ r a lysis 




j S_ 

Commoner TtV 
Coef f ic ient 


SES(S) 




Pretest 
(P) 


EdExAg 

Variables 

DT and N>tIN OO*"' 


Teaching 
Qua 1 i f i- 
■ ; eat ions (T) 


U(X.) 

L 


\ 


.00051 
.00084) 




.44742 
(.74504) 


.07419 
(.12354) 


no s s s 
( .00925) 


C(S,P) 


( 


.08334 
.13878) 


\ 

\ 


.08 334- 
(.13878) 






C(S,K) 


( 


.00041 
.00068) 




i 

1 


.00041' 
(.00068) 




C(S,T) 


( 


.00056 
.00093) 








000 SfS 
(.00093) 


C(P,E) 








-.02047 
(-.03409) 


-.02047 
(-.03409) 




C(P,T) 




i 




.01452 
(.02418) 




(.02418) 


CI(E,T) 










.00313. 
(.00522) 


• UU J J .3 

(.00522) 


C(S,P,E) 




. U2:>U 7 
.04175) 




. -.02507 


-.02507 




C: S,P,T) 


c 


.01848 




.0184 8 
( .03078) 




.01848 
(.03078) 


C(S,h,T) 


(-. 


,00109 
,00182) 






(A 001 82) 


-.001 09 
(-.00182 ) 


C(P,K,T) 








.00135 
. (.00225) 


. U0 1 35 
(.00225) 


.001 35 
(.00225) 


C(S,P,E,T) 


(-. 


,00229 
,00382) 




-.00229 
(-.00382) 


-.00229 
(-.00382) 


-.002 29/ 
(-.00382) 


R 2 (X. ) 




07484 




.51727 


.0301 5- 


■ .0402] X 








? 

FT(S, 

? 

rr(s, 


,P,E,T) = . 
,P.,D,T) + = . 


,60052 : 

,66135 





* Below each commonality coefficient: and in parentheses is the, normal ized 
coefficient; that is, the commonality coefficient divided by \ ? (S ,P , E , T) 

**IH and NMIN are abbreviations for D^ro- ..f Tnd i vidua 1 i y.u ion' and \umW 
of Minutes per 'Day. ' 

+ The multiple correlation squared of posLt:c:jt v ith SFS, ;*ieLe.::t, the clumi 
variables encoding KdExAC j;roup membership and the thro.* key teacher 
variables. v 1 
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« TABLE Vr-ii-3 

Commonality Coefficients* for the Degree of Individualization Growth Model 
Cohort 4, Spring 1972, Reading Total Score Analysis 



Commona lity 
Coefficient 



U(X.) 



C(S,P) 
C(S,E) 
C(S,T) ■ 
C(P,E) 
C(P,T) 
'C(E.T) 
C(S,P,E) 
C(S,P,T) 

\ 

C(S,E,T) 

c(p,E,<n 

C(S J\E,T) 



SES(S) 



Pretest 
(P) 



EdExAG 
Variables 
Dl' ind NMIN(E) 



.00799 
( .011211) 

.13083 
(.18358) 

.00010 
(.00013) 

.00017 • 
( .00024) 



.567 74 
(.79665) 

.13083 
(.18358) 



\00167 
( .00234) 

-.0032JL 
(-.00461^ 

'.00006 
( .00008) 



.00010 • 
( .00014) 



.00004 
(.00006) 

.00612 
( .00859) 



.00167 
( .00234) 

-.00328 ■ 
(-.0046 1 ) 



-.00043 
(-.00060) 

.00010 
( .00014) 



.00149 
(.00210) 



.00010 
( .00013) 



.00004 
( .00006) 



.00004 
( .00006) 

.00167 
( .00234) 



.00006 
( .00008) 

- .00043 
(-.00060) 

.000]0 
(.00014) 



Teaching 
Qualifi- 
cation s (T ) 

.00003 
( .00004) 



.000] 7 
( .00024) 



,00612 
(.00859) 

.00004 
( .00006) 



-.00328 
(-.00461 ) 

.00006 
( .00008) 

-.00043 
(-.00060) 

.00010 
( .00014) 



R?(X.) 
i 



1 3 762 



.70279 



.00 30 7 



.00280 



R ( S , P , H , T ) 



71266 



R*~(S,P,I),T) 4 ' = .7321 6 



*Bclow each commonality coefficient and in parentheses is the normalized 
coefficient; that is, 'the commonality coefficient divided by R 2 (S,P.F,T). 
**DI and NMIN are abbreviations for Degree of Individualization and Number 

, of Minutes per Day. 
+ The multiple correlation squarH of por.tiesl with SES, pretest, the dummy 
variables eneodi:i£ KdE>:AC group ,;;oinbersh i p and the three key teacher 
variables. 
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TABU* V-t v 0 

Commonality Coot" f ic Lerits* for the Degree of Individualization Growth Model 
Cohort 4 , Spr ing 19 7') , Read ing Tola 1 Score Ana lysis 



Common;! 1 i t y 
Coef f ic itMi t 



i 



cis , n 
( : c s , k ) 

C(S,T) 
I'lM'j 
C(1M) 
t:(K,Tj 

C(S,!\K) 
C( S , \\T) 

c:(s,k,t) 

U l\i..T) 

i'( s. i\ »: . 



r ( x . ) 
i 



SKS(S) 



.00 588 
( .00798) 

. J4263 
( . 19 3^2) 

-.000 35 

(- .0004 n 

.00000 
( .00000) 



.ocnao 

( .00528) 

.00000 
(- .00000) 

.00006 
( .00008) 



-.0002.3 
(-.000 31) 

. 151 88 



'rot est 



. 58490 
( . 79 '3 18) 

. 1 426 'J 
( . 19 342) 



- .00 2 56 
(- .00348) 

.000 19 
I .00025) 



.00 389 
( .00528) 

- .00000 
(- .00000) 



.00006 
( .00009) 

- .00023 
(-.000 31 ) 



; 2887 



KdKxAO 
Va r i ah 1 es 
i'T and NM1N(K) 



Teach i ng 
Qual il i- 
rat i uiis(T) 



.0029 3 
( .00 39 7) 



- .000 35 
(-.0004 7) 



- .00 2 50 
(- .00 34 8) 



.00000 
( .00000) 

.00 389 
( .00528)" 



.00006 
( .0000 8) 

.00006 
( .00009) 

-.00023 
(-.00031) 



.00 \Hi) 



ir(S,I\K,T) - .737-0 



R~(S,I\D,T) 



7 5912 



.oooo; 
( .oooo: ) 



.00000 
( .00000) 



. OdO 1 9 
( .0002 5) 

.00000 
( .00000) 



-.ooopq 

(-.0t*(&§) 

.OOQ 0*6 
( .00008) 

% 0000 6 
( .00009) 

- .0002 3 
(- .000 31 ) 



.yj)009 



*Below each commona L i t y coefficient and in parentheses is the normalized 
coefficient; that is, the commonality coefficient divided hy R- ( S , P, K ,T\ . 

and N M I N are abbreviations for Degree i.f Individualization and Numh.-r 
o f M i nut es per Day , 

4 The multiple eurrelat ion -squared of post : -st with. SKS, pretest, (lie duhvv 
va r 1 ah 1 c> en rod i nj; KdKxAC ,\vr r:ie..!bei sin p and I. he t h rer kev teacher 
var ''ables , 
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TABLE V-C-5 



Commonality Coefficients* for the Degree of Individualization Growth Model- 
Cohort 6, Spring 1972, Reading Total Score Analysis 



Commonality 
Ccef f i cient 



U(X.) . 

i 



C(S,P) 
C(S,K) 
C(S,T) 

c:(p,k) ' 

i 

C(P,T) 

c(i: ,r) 
c(s,}\ k ; 

C(S,E,T) 

c(i\e,t) 
c(s,p ,e,t) 



SES(S) 



.00479 
(.00643) 

.0 7180 
(.09641) 

-.00047 
(-.00063) 

.00021 
( .00028) 



.01 895 
( .02344V 

.00481 , 
( .00646) 

- .00017 
(-.00023) 



.01390 
( .01866) 



Pretest 
(P) 

.61589 
(.82702) 

.07180 
(.09641) 



.00600 
( .00806) 

.00 369 
( .00496) 



.0 1895 
( .02544) 

.00481 
( .00646) 



.00250 
(.00336) 

.01390 
( .01866) 



Ed Ex AC 
Variables 
D_I and NMIN(E) 



:00279 
( .00375) 



-.00047 
(- .00063) 



.00600 
( .00806) 



- .00014 
(-.00018) 

.0189 5 
( .02544) 



-.00017 
(-.00023) 

.00250 
'( .00336) 

.01390 
( .01866) 



Tench ing 
Qual if i- 

.00,016 
(.00022) 



.000 21 
( .00028) 



.00 369 
( .00496) 

- .00014 
C-.00018) 



.0048! 
( .00646) 

-.000 1 7 
(-.00023) 

.00250 
( .00336) 

.01 390 
( .0186ft) 



R"(X.) 
i 



11 381 



73754 



.04336 



k"(S,PJ- ,T.) 



. 744 7 1 



A 2 .(. s .0UP.>JJL= .74923 



.02497 



*Below each commonality coefficient and in parentheses is the 'norma li zed 
coefficient; that is, the commonality coefficient divided by R 2 (S,P E,T) 
**DI and NMIN are abbreviations for Degree of Individualization and 'Number' 
of Minutes per Day. 

+ The multiple correlation squared of po.stt.ost with SES, pretest, the du^r.jv 
variables encoding ldExAC group membership and the three key teacher 
variables. 
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• - tabu: v-i;-»y 

Commonality Coef f icent s* for the. Degree of Individualization Orowth Model — 
Cohort 6, Spring 1973, Reading Total Seore Analysis 

■ - . _ \. .* _ . ! I ~ _ ~ ~ J J ~ f . . - - 

Commonality ' Pro Lost f:dKxA(; Toaehin>; 
Coef f u: lent bhb ( S) \ ( P ) V ' ,r 1 ah 1 ... Qua 1 i t i f i - 
" \ ... _ 01 and NMJ_N(J"X oat ions(T) 

.00 1 A 5 \ .62018 - .00757 . .00003 

(.00194) \ (.82729) (.0 1010) (.0000V 

C(SJ') .07644 * .07644 

( - 10197) ( . 10197) 

c(s,n . .oooii .00013 

(.000 17) (.00017) 

C(S,T) -.00002 -.00002 

(-.00003) (-.00003) 

<-(I\K) .00127 .00127 

( .00 169) ( .00 169) 

< : <1\T) .00188 .00188 

(.00250) ( .00250) 

^.(K,T) -.00000 -.00000 

(-.00000) (-.00000) 

C(S f l\K) .02565 .02565 .02565 

( .03421) ( .03421 ) ( .03421) 

C(S,I\T) .00311 .00 311 .00 311 

(.00414) (.00414) (.00414)' 

0 ( S , K , T ) 1 - . 00000 - . 00000 . o 0000 

(-•00000) (-.00000) (-.00000) 

C:(1\K,T) .00072 .00072 .00072 

(.00096) (.00096) (.00096) 

C(S,P,L,T) .01125 .01125 .01125 .01125 

(.01501) (.01501) * (.01501) (.01501) 

R"('<.) . 1 180 1 . 74050 . .04659 ' ,01696 , 

jr(SJM-;,T) - .7496 5 
R 2 fS,P_ 1 /i_ f T)^_= .7 5427 

*Bclow each commons 1 i t y roof f i c ient and in parentheses is the normalized 

coefficient; that 'is,^ the commonality ooofficient divided by R 2 ( S , P , E % T) . 
**DL and NMTN are abbreviations for Degree of Individualization andVimber 
of Minutes per Day. .> 

+ The multiple correlation squared of postl.est with SKS, pretest, the dummy 

variables encoding Kdi:.*A(l ^roup membership and the three key tea.cher 

variables. r 
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APPENDIX V-H 

Comparison of Key Analysis Variables 
for Positive and Negative Outlier EdExAC Croups 
rom Cohorts 4 and 6 - Reading Total Score Analys 
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tabu: v-h- i 



Comparison of Key Analysis Variables 
for Positive and Negative 1 Outlier F.dF.xAC Growps-- 
Cohort 4, Spring 1972, Reading Total Score Analysis 
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TABLE V-H- 1 (continued) 
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| Utilization of 
j Ob j eet ives 
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I Individual izat ion 
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L'se of Performance 
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Teaching Unit 
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Utilization of Student 
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Degree of Individ- 
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dumber of School 
davs per Year 

Number of Minutes 
per Day 
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0.4 3 0. 54 0.4 3 



.67 1.67 1.00 



■00 2.00 1.00 
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. 00 
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1.6 7 3.00 I. 00 
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TABLr V-li- I I Continued) 
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TABLK V-ii- 



Comparison of Key Analysis Variables 
for Positive and Negative Outlier KdKxAC Croups- 
Cohort 4, Spring 1973, Reading Total Score Analysis 
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TABLE V-H-j (conf inued) 
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I n s l rue c i ona 1 Pa c e 

Schedu 1 i ng Charae- 
t e r i s t i c s 

L'se of Performance 
Agreements 

j Classroom Croup 
1 Organizat i on 

j Teach ing l. : n i t 
| Compos i t i on 

Completeness of 
Instruct ional Package 

Utilization of 
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Level of Innovation 

Degree ol Indi- 
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Number of School 
Days per Year 

Number of Minutes 
per Day 
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2.00 2.00 1.00 
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TABLE V-H-2(continued) 



Variable 

Teacher/Student 
Contact Ratio 3 

Number of Teachers X 

Teacher 1 s Age X 

Teacher f s Socio- X 
economic Background 



Teaching Quali- 
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Greatest 
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3.97 
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100 .62 



^Relative measure of teacher /student contact equal to the percent of teacher 
time per individual student. 
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TAB I.F. V-H-3 



Comparison of Key Analysis Variables 
for Positive and Negative OutliiT KdlixAC Croups- 
Cohort 6, Spring 1972, Reading Total Score Analysis 
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1.0. J 3 
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-1.28 

0.9 7 
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5A 
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-0.02 
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65. 78 
0.10 

5 "13.28 
76.46 
-0.38 

10 5. 79 
8.75 
-0. 36 



99,37 
9 .00 
0.5 7 
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11 0 

-9.69 
34.05 
0.53 

4 72. 17 

63. 72 

1 .04 
( 

483.06 
1 

68. 75 
0.52 

10 3.06 
9.23 
-0.0 5 
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9 .26 
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8.68 
0.44 

0 . 39 
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4 1.93 
-0.11 
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7 J .01 
0.07 

550.79 
85.59 
-0.0 3 

100. 48 
9 .46 
-0.0 1 

100 .89 
9.18 
-0.08 

10 7.2 3 
8.42 
-0 .87 

0 . 85 



232 

8.64 
32.08 
-0.19 

487.90 
66.59 
0.'48 

513. 77 
69.88 
0.19 

99 . 57 
9.17 
-0.08 

100.07 
10.48 
-0.01 

9 3. 16 
6 . 69 
1 .27 

0.97 

(font 



105 ' 

8.31 | 
43.76 
-0.28 

528.89 I 
7 1 . 1 0 I 
-0.19 

557.61 ; 

I 

82.02 • 

l 

-o. 1 5 ; 

101 .78 i 
9 .06 I 
-0.11 

100 .97 

9.07 j 
-0.07 ! 

107.0.1 
7.39 
-0.71 ; 



0.90 
i nued ) 



N 



1 N 



2 

For binary coded variables [he >; \^ equal to the 
proportion of si udenLs coded villi a "1." 

*Note: Blank entries indicate no data col lee tod. 

- ' - V-H-7 



whore g - skewness index, 

x = deviation of a score 
from X, where X is an 
EdExAG-group mean tor 
variable X, and 
N = number of students . 
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ami h V-ll-3 (continued) 
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.00 


I 


. 50 


1 


. 50 




. 50 




. 50 


2 


.-50 


Utilization of 
Student Evaluation 


3 


.00 


1 


.67 


1 


.67 


3 


.00 


3 
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ERIC 



* Variabl e 



.Number of. Teachers X 
! Teacher \s Age X 

!Teacher ? s Socio- X 

'economic Background 

I 

(Teaching Qua 1 if 1- X 
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Negative Outliers 



4.00 L.00 1 .23 

29.50 24.00 " 36.91 

111. 32 108.26 • 93.91 

85.18 81 . 18 102.22 



Greatest: 
_Po sit ive _0u tli e r s _ 

'2.7.1 1 .00 1 .93 

32.12 33.38 30.10 

97.40^ 101.45 ' '172. 20 

9?.8l 98.99 " 92.12 



y 3 . \ 
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Comparison of Key Analysis Variables r > 
for Positive and Negarivo Outlier EclKxAC Croups — ' 
Cohort 6, Spring 1973, Reading Total Score Analysis 
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8i 


50 


84 


38 


84 


. 23 


77 


.23 


89, 


01 


t 


Q 
r> 


— u 


1 c 

. 1 J 


U 


O 0 

. *:o 


U 


r\ 0 

08 


0 


. 1 7 


0 


.21 


0 


30 


Reading Interest 


X 


98 


.87 


99 


.13 


102 


24 


99 


.56 


101 


.35 


101 


48 


SP72 




























i ( 


10 


.26 


9 


16 


10. 


62 


10 


.48 


9 


.74 


9 


40 




8 


0 


.08 


0 


36 


-0. 


34 


0 


18 


0 


.04 


-0 


12 


Reading Interest 


X 


98 


87 


q 7 < 


04 


100. 


65 




04 


100 


.42 


99. 


6 1 








76 


















SO 


a 


9 . 


3 7 


9 . 


82 


j 10 


23 


9 


.99 


10. 


35 






0 


.07 


0. 


38 


-0. 


34 


I 0 


1 5 


0 


07 


n . 


05 


■ r;:s * 




105. 


12 


103. 


26 


104. 


62 


j 96 

j 


1 0 


109 


0 3 


10 7. 


1 5 




SD 






LI . 


0 7 


7. 


9 y 


6 


88 


6 


9 6 


7 . 


94 








30 


-0. 


86 


-0 . 


68 i 


0 . 


6 7 


- 1 


16 


-0 . 


81 


Ethnic Croup- 


v i 






n. 


8 ; > 


0. 


8] 


( ) . 


96 


( i 


98 


0. 


9 3 



(white-] ; tmn- 
wh i l e=0 ) 



1 index of sk^viu-ss 



N 



N 



; jr i: :r , .;c-- <<od<'( •> 



r < ah le:; Liu: X ...s equal t o the 

v . o will- a M l. n 

V-H- !0 



(cunt i Jiued ) 



whore g = skewness index, 

x = deviation of a score 
from X, where X is an 
EdExAG-group mean for 
variable X, and 
N = number of students. 
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T AISLE V-H--4 (cont inue.d) 









Var inb lo 




Cn 
Wgar i\ 


•arosr 
v Out 1 i 


er s 


1 

■ 




("real 
Pes i t: ive 


est 
Out J 


i e r s 




Se:< :: X 
(gir 1=1 ;boy=0) 


0 


52 


0.48. 


0 


.55 


0 


. 55 


0 


.49 


0 


.57 


L T t i 1 i/ar ion X 
of Object ives 


3 


00 


3 . 00 


3 


. 00 


I 

1 


h7 


V 


.00 




00 


liui iv i dun I izat ion X 
in Decision Making 


1 


00 


1 . 6 7 


7 


.00 


1 

1 


00 


l 


00 


1 


33 


Teacher or Locally 
Devel oped Ma t er i a Is 




00 


J. 00 


> 


00 


i 

1 

i 
1 


00 




50 


1 


30 


Indiv idua 1 iza t ion of 
Ins t rue t i ona J Pace 


2 


00 


2.00 


3 


.00 

I 
! 


< 1 


.Of). 


2 


.00 




00 


Schedul ing Charac- 
teristics 


2 


00 


2.00 




.00 

i 


i l 

i 


.00 


3 


00 


2 


00 


Use of Performance 
Agreement s 


3 


. 00 


2 . 00 




.00 


| j 


.00 




.00 




00 


Classroom Croup 
Organ iza t ion 


1 


00 


2 . 00 




.00 : 

1 




.00 


*) 


.00 




oo 


Teac h ing Un i t 
Compos i tr i on 




. 50 


2.00 




! 

.50 j 

. 


:1 


.00 


1 


.00 




. 50 


Completeness of 

Inst ruct i onal Package 


2 


. 50 


2. 50 


> 


. 50 


1 


.00 




.00 


1 


50 


Utilization of 
Student Evaluation 


3 


00 


3.00 






i 

i 


. 33 


3 


.00 


3 


.00 


Level of Innovation 


2 2 


00 


2 3.17". 


24 


.33 j 


! M 


00 


2 1 


. 50 


20 


.8 i 


Degree of Tndi vid- 
ua 1 i zat i on 




00 


8.^7 


10 


. 33 ; 


u 

i 


. n 


8 


.00 


H 


n 


Number of School 
Days pe r Yea r 


200 


.no i 


SO .00 


200 


.00 


U52 


.00 


1 7<S 


.00 


2 00 


.0(1 


^umbe r of Minu t es 


50 


.00 


50 .00 


50 


.00 


50 


.on 


30 


.00 


50 


.oo 



per Day 

( c« >n t i nued ) 

'°Por binary coded variable.': the X is equal tn the 
proportion of :,t ud^nt s coded with a "1." ^ 
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TAHLR V- 



( con t Lnued) 



Variable 

Teacher /Student 
Cent ac t Rat io ' 

Number of Teachers X 

Feaclior 1 s Ai»r X 

Teacher's Socio- X 
eeonomi c background 

Teach ing i]un 1 i f i- X 
'\it ions 



Greatest ; Greatest 
Negative^ Out 3 iers j! . Positive Outliers 



3. 3 3 

1.02 
30.00 



4.00 

5. 59 
38.00 



1-00.9 '3 10 3. 1 A 



3. :n 

1 .02 
40 .00 
93.95 



I 



3 . 3 3 

1 .00 
39 . 1 8 



2.8fS 

6 . 00 
34.00 



102 . 18 1 10 . ! S 



90.fc2 100. r )8 L06.55 103.18 91 SO 



3.33 

I .02 
24.17 
107.04 

9 2 .4h 



Relative measure of teacher /student contact equal to the percent of readier 
time per individual student. 
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APPENDIX V-I 
Language Total Score Analysis Tab le-' ' 



^- 

Variable names for the abbreviations used in this appendix are 
f ou id in Appendix IV-H. Methods to be used for testing the statistical 
significance of the correlations shown vary depending upon whether or 
noc the variables were measured at the student level or at the EdKxACJ- 
group level. These issues are discussed in Chapter IV and in Appendix 
IV-E. . " 

f Critical values for the correlations of the EdExAG variables with SI 

pretest and posttest are found in Tables V-I-18, V-1-L9 and V-I-32 as 
are tae critical values for correlations among the student-level variable 
Critical values for inter cor re la t i ons of EdExAC- 1 eve 1 variables with 
KdExAG- leve J variables are noted on each of the tables in which such cor- 
relations have been included, along with the effective sample size, 
k eff (see Appendix LV-H) . EdExAC-var iab Le correlations exceeding the 
noted value are statistically significant at p .05 (two-tailed) with 
^eff ~ ^ degrees of freedom. 
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Descriptive Sun? of tl.o Language Total Score Analysis Samples 



Variable 


fohrt 1 
SP72 


S' : ?i 


ri •'. Cohort 4 


Cohort o 
S??2 


CcLf.rt li 
■ 5P73 


Grade (pretest y t ut /p?. 


attest vear) 


:/j 


5/6 


5/7 


7/8 


Total Nur.bur o: Sldem 




755 


:5'i 1902 


1491 


1507 


Number of KJExAG oroup; 


i ' 1J 


17 




11 










42 44 


13 


I^bor of Different 












Schso It /Sites 


13/5 


13/5 


35/13 ].;/n 


7/7 


m 



'■w CO and Ss^aril 
iation (S3) 

.virile :( Sii v sr. 



Po^e^t-Lan^/.e btai L'core 
Rcj iJ'.ja Lir.ud for 1;^ of 





33;. 31 


63.34 


400,00 


63.03 


476.31 


76.27 


510.72 


75.75 


528.91 


60,09 


5-31.0? 


51.42 


National Sora - PosttiW ' 


327 




3S2 




4M 




497 




531.5 




557.0. 




Priifsi:-!.:nrua.:e Total Score 


























;or me or 


























Testi;..> 


93. or 


tO,(;C ; 


324. (x, 


o4, l )l 




6-J.02 


480.54 


72.2) 


510.8$ 


6«.59 


545.33 


73.99 


!ni:;or.;il Nor^ - Pretest' 


S5' : 




337 








461 . 




497 




531.5 ■ 




Sccioocono^ic Status 


100.0S 


).W 


100.92 


9.92 


W.5h 


4.97 


99,78 


9.58 


99/" 




100.21 


9.79 


Utilization of Objectives 


2. DO 


0. 72 


:.6') 


D.64 


2.43 


0.84 


2.48 


0.71 




0.76 


2.48 


0.65 


Individualization in,, 
























Decision Making 1 " / 


s 


0.53 


1.50 


0.31 


1.39 


0.43 


1.39 


0.42 


1.26 


0,30 


1.26 


0.33 


Teacher or Loea^y DevelrW. 


























Materials 


1.66 


[1.43 


1,76 


0.37 


i.so 


0.55 


1.93 


0.57 


2.34 


0,60 


2,40 




(continued) 



'The 50th percentile score in Expanded Sale Scor, units for tc,ti:n; codecs :,:v W n soath 6 ad 9 for lor, k (SP71.5P73) and 
J 0 " Q (S?;2) ■ fro ° norcs ^ i: " ^ tlfiS Oner's Interpol.^ scale .core nor,, have a deckal point. 
, 'Based on Cl}01 Mental Age - Language score fro: Spring 1971. 

Voiding to the CTMM torV'taal a grade placet of 1.7 (the -ppmisate cia of testis?) corresponds with a 
chronological age of 85 Biathj. 

"One of the scales summed to few cue scale Degree of Indiviauahication. 
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l.T. 
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— 
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V 
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u » tj 7 






2.1 yl 0,6i 


2.01 0.76 


1.93 


0.58 


Schcilulini; Chr.r^tv 
LVn' o: :'jr:o:T.,i:! k :c 




• « / J 


0,7*1 


1 1"* 




!.n7 U.5J 


1,:0 O.hj 


, 1.6") 


0. 56 


A r c L* n t s 




1 h 1 


ii i 




I'V'J I, J! i,,'J» 


1.72 0.7.4 




l.t- 


0,71 






1 n 
, 1 J 






O.^ Uri7 li.'/j 


2,1; -C,'!2 


2.::; 0.'.2 


l.v, 




T0.1'''l I'l ' "'> ' t i'ij" *.\< 




1 ft*) 


0.72 


* * hi. 




!.■- D.oi' 


i.io a.w 


!.''■) 


0,6a 


Co.ii;)K , 'i , r l ^'i.s of iui; 
























2.21 


O.Gi 


2.11 


0.5; 1.97 .)/),: 


2.i)j ■;),;-; 


1 i) r i n p 


1 ; , "i 
. , /J 


j.63 


L 1 1 * .lit U t J v 




















Ev.iL.:i„:r 




2.45 


0,63 


2.5: 


i '. ■■ 1 2 !i 10 


2 , 5 ; i u ! 










li:.ition 3 


:.n 


1.83 


h . 2 0 


1»;7 7 ' ,| "' ' 




7.l^ i.ei 


:,!:' 




Lt:Vi:i of •r.ov.ilioiv 








21.05 




i 'i , ; ) 3 , j r i 


In ''7 .! ^ 








;r Day 


9'..?; 




'•)).'< 3 


i-.:7 VJ 


:),'■) 


iJc ir.^7 










31.8!) 


7.80 


)5.i r. 


Ui2 h:2 !...;.! 






jo, 1 ;? 




























l:*2.52 


7,d7 


i;U: 


<VO 


'«)..'/ U! t: 




. ^ , w'J 


(i H ' 


Tea:hi:\ s ')::jii:i,.iti 




✓ 7 . > " 




!:*).% 


''.12 ! ; '; 


i u - ' •> ' ' f 


'.o.H rl.22 




b.'.o 


" i --ne c: tho uc.i Los i 




or: ci.c 


scilc D'j/.roc of Ii 












A superir.Jex ^qiijl 


to ciu si:: 


; of the 


four seal 


l ri I t J IfL ti 


in fdir.ijt-: 4. 










'A siiperir.de>; equal 


to g;s: 


; of iho 




^ fjOalcSj 


i vt il » >l ion of Cd 1 ■ i , f ) 


L:;r jl^:-, r:ili.:a::oa of Sudcnt 


EvakatioiH 





1 

ERIC 



TAI1LI- v-i- 



Mcan Differences between Lan^ua^e Total Pretest: 
and Post test Scores ami Standardized (Jains 



Cohort. 1 Cohort 4 ' Cohort 4 Cohort h Cohort n 
SP73 SP72 SP7 3 . gP72 SP/J 

iUrlerenco J8 " 79 " »«-"2 1 1>- 34 

"Standardised" 

• • • l W . i)4 .41 '4 ' l 



The SP72 comparison Ls not included lor Cohort 1 because the CT.HM Ment 
Aue- Lanmjaj:e wa;; the pretest measure. 

i'V'V!] !.i|i».n i «:i V- | i ii ( ;k- «t ■ .:.t . 



9 

ERLC 



347 



600 



Coh a / t i 




'300 




LONGSTEP Analysis Samples 
CTRS Nnt ional Norms 



6.7 7.7 8.7 



Oracle and Month 

Figure V-I-l. .Pretest and post test means ;md published national nor 
(50th percentile fei spring testing) - Language Total 
Score Ana Lyses . 
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TAB!.!-: V- I- S 

Pes 1 1 es L /Nn rni and Prvtes t /Norm Comnar i suns 
I.:m:.;u;ij;o Tola ! Si-dH' Ana 1vsl\s 



Pes t Cos t Mean/ 
Nom i) i t I o rtMUT 



Coitn r t. 1 i lo! uM*t h ( 

SP71! SI' 7 "3 " SP 7 ^ SP71 S I* 7 2 S! 



'*] 18.00 1 r >. H 1 J. 7, 



-2 . V) 



Pos l t es t i)if f erenrt.' 
Rat in- 



. 12 . 2h 



2U '.IS 



-.0 3 



Pretest Mean/ 
N'oriii Hi f 1 eivnc 



7. Oh l r >. M 



Pretest Hi ftervnee 
Rat i e 



Nor:;; hasec! en "SOih pereentile for spring lesiiin 

X - \en:: 

pes L. (. eS L 

pes 1 1 i;s t 



a - Norm 

p rt- test 

SO 

pretest 



CTMM was use-d. 
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TAB V-l-4 

Maximum Po<<s Lble Post test and Pretest Moan Shifts 
Attributable to Test Topout Effects - 
I ' nuage Total Score Analyses 



Cohort , 
Ana Lys is 
Sample ] 

Cohort 1 , 
SP73 

Cohort 4, 
SP72 

Cohort 4, 
SP73 

Coli or t 6, 
SP72 

Cohort 6, 
S P 7 '3 



Analysis Sample 



Ana Lys is Samp 1 c 
and Topouus*' 



VsLtos t: V-tes t |_ N ^pos ttest, pretest. N _ 
400.00 334.06 j 755 400.31 334.46 756 



476.31 437.52 



510. 72 4E0.54 



Mean Difference" 
Post test Pretest 



.31 



. 40 



1 .60 1 . L6 



1995 477.91 438.68 2007 

1902 513.38 '483.55 1924| 2.66' 3.01 

i 

: i 
528.91 "51.0.89 jl49 1 532.08 , 51.2.75 1503| 3.17 



56 1 . 67 545. 33 ! 1507 561.67 



545. 33 1 507 J .00 



1 . 86 



.(JO 



Cohort U SP72 is not included because the pretest was the CTMM and the 
posttuf ' . the CTBS . 

Means shown here were computed assuming that students who topped out 
obtained the maxiiiU.i pretest and post test scores. 

3 Absolute value of the difference. 
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ComnoiKi 1 i L v Analysis nf SMS -- 
Cohort 1, Spring 197J, I.an>uwn;o ToL.i] Smrr Annlvsis 



I'rt't fsf IxiKxAO 'IV;!chfr 
. . . _ . (y) J.l uni . n L v . C'jul^s (D) V;ir i ;ih i t-s ( i ) 

np,D) -.0 i ::-jh -.ni >k 

C(i\T) .000v, .0 0( )^) 

C(1 : \!),T) -i 001 On • -.00] Of) -.00 1 Of) 

''<"' UXj > .0J'.«'4 . 17 7 *!» .0:^)h') 

? 

/ i'ABLK V- I -i, 

i.om-ion.'i 1 i t v AiK'i ! vs i s n i SKS 

Cohort: 1, Spring 1 L . J 7'>, I..mgu.'ij;o Totnl Sivit An,«lvsis 



r(x.) . 
i 

c<i\n> 

C(!\T) 



.0381 J 
. 08 J ^ 7 
.00101 



KclKxAO" 
Ihminiy ' Codi'S ( I) ) 

. 0H. M J7 



. 0-'t 0-VJ 

. o;>voo 



Vn r ijibUvs (T) 
.00'WO 



.00] 01 
. 0 'OK'OJ 



K"lX. ) 



1 -'0.hr-> 



. .'#2 1 c .; c > 



. 0 72 ^8 



TABLE V-I-7 

i <■ 

" Commonality Analysis of SKS — 

Cohort 4, Spring 19 72, Language Total Score Analysis 



Pretest ' EdExAG """" " Teacher" ~ 

._ {?J : Du mmy Codes (D) Variabl es (T) 



U <V -02366 .41364 . .00071 

C(P,D) ■ .05603 .05603 

C(P,T) .00066 .00066 

C(D.T) .04596 .04596 

C(P,D,T) - . 0002 7 - . 0002 7 - . 0002 7 

r2 (-V .08008 • .')1536 .04706 



K''(P,D,T) = .54039 



TAHLK V- I*-.S 

Commonality Analysis of SKS — 
Cohort 4, Spring 1973, Language Tola] Score Analysis 



LTX.) 
i 

C(i\D) 

c:(p,t ■ 

C(I),T) 
C(I\D,T) 



Pretest 

-021 16 
.059 5 5 
,0004 5 

.01 354 



EcIExAC 
Punmy Codes (J) ) 

. 33699 
.05953 



i)969 5 
,01 354 



Tcache r 
Variables (T) 

.00049 



.0004 5 
.09695 
.01 354 



R~(X.) 



,09470 



50 702 



J L 



ir(P,I),T0 = . 5291 3 



V- [-13 
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Commons J itv Analysis of SKS 
Cohort ft, Spring l<)/2, Lanfcua. Total Soore Analvsis 



Protest • VfifKxAc"' 



Toa rhor 



-O'J iHin^jAui^sO^) J. .VarlahK s(T) 



|:i V .01470 . ,0^,7'^ .J00S0 

C(L\!>) .01838 .01858 

I'd'; n . nf)(jh7 

( n .07 u 

c*( r, i>, n .pifj'W .ok,^ 



. O00f>7 

1 1 . 0 7 r )b r i 



.01 h i ( J\ 



(X. ) .O'lOU . J()nl 7 



K"0\I),T) - . 12204 



"iAl-W.K V- I - lo 

Commonality Analysis of SKS 
Cohort n. Spring 1 l ) 7 5 , Lam;iia^r Total S»:on- Analysis 



,0 ( ) 



»" -t KclK\AC 



i radio v 



him&z >± % ^<\y*(\}) Va r i ah N.-s ( I )' 

.0001 i 



l'(>;. ) .20718 

CM\i>) .02831 .028,1 

1 1 ' .nooji BOnrjJ , 

1 ( 1 1 ' 1 1 .04097 . 040M 7 

C» !',!', I ) .:VJH27 .00827 ' .0082 7 



- - - r ■ I 

\ - 

n\o,'i j - . ii 7^; 

- - -» -v 



V 

• v 

( 

\ 



ERIC 



\ 

\ 

\ 



TABLE V-l-1 ! 

Common;? 1 i ty Analysis of Protest — 
Cohort 1, Spring 1 9 72, Lam; 'aire Total Sooro Analvsi: 



r(x.) 
t: (s , m 

<'(S,T) 
(MS,!), i ) 



SKS (S ) 



, () J0S1 
,00] I 0 

, DOJO'i 



KilKxAC 
i)umniv i!(tiit's(i)) 



. 09 son 
■.(rum 

. o(V; i 

-.00 : 0"i 



I i-aoiu' r 
V.ir i all ! t >s ( T ) 



.'0() r 



.001 



Hi.'!)' 



}; o:. ) 

! 



.no-:; | 



i i 1 : r. ■ >. ;i - 

!.'f :1 S. M". 



iri..!.l. 
f » 0 ) 1 1 



ERLC 
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TAKLK V- I - I. J 
\ 



Commonality Analysis of Protest — 
Cohort 4, Spring 197^ Language Total Score* Analysis 



l'(X.) 
1 

c:(s,n) 

C(S,T) 
C(S,i), I") 



SES(S) 

.04 Hi 7 
.0409 3 
.00188 

-.004^ i 



EclExAC 
I )j imjnv_ _Co d les (T > )_ 

.09579 
.0409 '3 



-.0001 7 
-.004 4 I 



Poacher 
Variablos(T) 



.01494 

.00188 
.0001 7 
.0044 1 



R- (X. ) 
i 



,08008 



. 1 Ml -I 



K (S, D,T) - . 19()h4 



TAlil.i- V - I - I 

i ](HMnu')na J i t y Ana 1 y s i s uf P rot us t -- 
Cohoi t 4, Sprin-::, 1^73, '.anguagt- Total Sroro Analysis 



IKX. ) 
i 

C(S,IO 
C(S, r; 
C(i'),T) 
f:(S,»),'i ; 



SJ\S(S ) 
. 0 Jh4 r 3 

. 0')! J J 

.«)'.» j ; ; 



l-clExAC 
liunimv ^Codos ( I)) 

.08S89 

.ovn r i 



. 00'»4i) 

. ntv\7 7 



IVaoho r 

.01 : } 8r> 



.001 H 
.0044 0 

.oo \n 



t . f A . ) 

i 



i h ; l 



.()] T)h 



:j5) 



ta ;;!.!■: v- 



ERIC 



C'niTimona 1 i t y Analysis of IMvtosL 
lloliort h, Sp r i nv; I ( >72 , Lim;ua ;:;<.• lota ! Sen rv Ana I vs i s 



l'<X. ) 
1 

C(S,!)) 

( : ( s , r ) 
c: c n , n 



i 



• SKS(S) 
.01 : ')7ii 

. no i 



, tl'.OI 



Ouninw GuU'sJ D ) 
. 0 2 f S '4 1 

.01 r i7fi 



.001 ih 

.ni v*7 



-0 r )M I 



IVariu' r 
Var injij r CT) 



001 08 
' . 001 ■ «*■> 
.01 t.*7 



. o.. 1 » id 



i.ikt. n.i I i f v 



AfW.F-: V- f - 



Ana 1 



• a . i 1 V S ■ ■( i r« ■ An. 



t-.tii x.M, 
n:-v v Cful.'H ( 0 ) 

.oini 7 



1 r.ic!).-r 
a v i a!) 1 * • ; ( i ) 

. 00. Ml'. 



)()<) 



. a()')/, 



i 10 



0 '/» j 



TAB Lb! V-I-17 



Proportions of. SES and Pretest Variance 
Attributable to EdExAG-group Membership 



Cohort 1 Cohort 1 Cohort 4 Cohort A Cohort 6 Cohort b 

SP72 _SP73_ S_P 7 2_ SIVH SP72_ S P7 3_ • _ 

SES 1 



R SES ( V 



.38 



.02 



31 



.28 



Pre tori t 

R*~ ( I) . ) 

pretest j 



.07 



.21. 



. 1 ■] 



.(Hi 



.04 



U AY).)- .10 

pretest j 



10 



. 10 



.09 



.0} 



.01 



I' (SES) .0ft 

pretes t 



.0 r ) 



, 0 4 



.04 



.02 



.04 



'Among-group J i f forcnc.es with respee.t to SES that wore independent of 
concomitant differences in pretest were not computed because of the 
theoretical primacy of SES; that is, it was reasonable to view SES as 
an antecedent of test performance hut not vice versa. 

•This commonality analysis uniqueness is equal to the proportion of vari- 
ance in pretest that is attributable to EdExAC-^roup membership after 
group differences with respect to SES and the teacher variables :\ro taken 
into account . 

This uniqueness is equal to the proportion of variance in protest that is 
attributable to SES , independent of group differences on SES and all 
teacher-variable differences; that is, it is a w i th i n-groups uniqueness. 



1 > T 7 
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TABU- V-I-18 



Correlations of SF.S with the Key Analysis Variables 
Language Total Score Analysis 





'1 of 
elation 


Variable 


Cohort 1 
SP 72 


Cohort 1 
SP 73 


Cohort 4 
SP 72 


Cohort 4 
SP 73 


Cohort 6 
SP 72 


Cohort 6 
SP 73 


lent/ 


Pretest 


.157 


.386 


.282 


.307 


.223 


.263 


:udent 


















Teacher's Age 


.016 


-.100 


' ■ -.032 


-.118 


-.095 


-.177 




Teacher's Socic- 
economic Background 


nn/i 




one 


. J2v 


.167 


.081 




Teaching 0 ial i- 
fication^ 


1 

, 1 jO 


r In J 


- .vvl 


-.071 


- . 256 


-.204 ' 


:A0,/ 
: udent 


Utilization of 
Objectives 


.312 


. 301 


.291 


■ .164 


.194 


.289 

i 




Individualization 
in Decision Making 


-.011 


.064 


-.008 


-.080 


.091 


.176 




Teacher or Locally 
Developed Materials 


.039 


-.191 


.07] 


~.]68 


. 004 


-.063 




Individualization of 
Instructional Pace, 


.120 


.232 


.248 


-.074 


.03.3 


.058 




Scheduling 
Characteristics 


-.022 


-.097 


.056 


-.107 


.346 


.363 




Use of Performance 
Agreements 


-.032 


-.089 


.075 


.087 


.128 


.354 




Classroom Croup 
Organization 


-.151 


-.098 


-.000 


-.224 


.132 


.04 5 




Teaching Unit 
Compos it ion 


.258 . 


.1*3 


.ns4 


-.008 


-.138 

'( conr 


.082 
ir.u.».n 



ERIC 



TAHLK V- I- 18 (com inued) 



evel of 
orrelat ion 

dExAG/ 
Student: 



Variable 



Completeness of 
Instructional Package 

Utilization of Stu- 
dent Evaluation 

Degree of Individual- 
ization 

Level of innova- 
tion 

Number \ Minutes 
per 1* ■•■ 



Cohort 1 Cohort 1 Cohort 4 Cohort 4 Cohort 6 Uhn>- 
SP 72 SP 73 SP 72 



.216 
.235 
.112 
.140 
.151 



(p - ,05, - 
S 'indent/,' . Liu-. 



vel ! 



.()(>9 



(p< .05) - 

EdExAC/StrJ.: t . Level- 



.055 



rv f 



it L. fonrxl . . 



.234 
.274 
.138 
.14* 
.17.'. 



.071 



.D54 



.311 
-21ft 
.191 
.207 
.073 



.030 



SP 73 
-.030 

-.140 

-.056 

-.081 

■.()% . 



.044 



.031 



SP 72 
.]4« 

.260 

.174 

. 102 

-.275 



.050 



.042 



.158 
.235 
.289 
.252 
•.363 



.050 



.042 



e-.-n lu; ;:tudu!t-[ jvuJ variabh 



i :'i-;.a::c ( ; 



• ■..1- :;r'.:.!L-nt-leve! \-zri .ol^ (SES) and 
Lw-'i-taili cj — f jt :o i^U'iiun 17- 1 for 



e: For convenience, all coefficients 
""abii-s V-l-20 t:n\Miu!i V- 



:iejts in this table were truncated to three decimal places — see 
> ii>r corr. -Tat irrs with » ivi-iilaci* aivuraev. \r 
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ERIC 



I'.M'I !■ V-1-I9 





Correlations 


of Pretest 


with the Key Analysis 


Variables - 










Language 


Total Score 


Anal ys is 








vel of 


V 1 T* 1 3 K 1 d 
\ ui 1 d L) ± t 


Cohort 1 


Cohort 1 


Cohort 


4 Cohort 4 


Cohort 6 


Cohort 6 


rrelation 


SP72 


SP73 


SP72 


SP73 


SP72 


SP73 


udent/ 


Socioeconomic Back- 


.157 


.386 


.282 


.307 


.223 


.263 


Student 


ground 














Teacher's Age 


.075 


-.029 


.052 


.054 


-.097 


-.094 




learner's Socio- 
economic Background 


.017 


-. 109 


-.006 


,089 


.OfW 


.036 




Teaching Quali- 


.038 


.141 


• .100 


.041 


-.149 


-.048 




fications 














e>:a;;/ 

Student 


Utilization of 
Objectives 


-.062 


1 i n 


.040 


-.021 


. 10J 


.085 




Individualization 
in Decision Making 


-.059 






-.049 


.035 


.105 




Teacher or Locally 
Developed Materials 


-.105 


- ,122 


-.046 


-.093 


.081 


-.039 




Individualization of 
Instructional Pace 


-.008 


.055 


.055 


-.088 


,o: } 6 


-.011 




Scheduling 
Characteristics 


-.061 


-.115 


-.045 


-.148 


.143 


.089 




Use of Performance 
Agreements 


-.089 


-.056 


.064 


-,01ft 


.157 


.077 




Classroom Croup 
Organization 


.071 


-.011 


-.014 


-.181 


. 1 3 C ' 


.016 




Teaching unit 
Compos i t ion 


-.LIS 


.0<)9 


-.007 


-.OH 1 ) 


-.05 1 

fi-oni 


.035 

i niit'd) 



>>0 j 



ERIC 



TABLE \~l-19 I'cunlijiued) 



,evel of 
lorrelation 


Variable 


Cohort 1 
SP72 


Cohort 1 
SP73 


Cohort 4 
SP72 


Pnli n r* h ■ A 

V AMI U [ L M 

SP71 


Coho r t 
SP72 


') 


Cohort 6 
SP73 


IdExAC/ 


Completeness of J 
Instructional Package 
















S t uuti'uL 


-.030 


.039' 


ObO 


.0/3 




.029 




Utilization of Stu- 
dent- Evaluation 


-.121 


,174 


.084 


-.082 


HQS 




• u / " 




Degree of Individual- 
ization 


-.092 


OA S 


.07b 


-.085 


. 107 




.078 




Level of Innovation 


-.097 


.020 


■ .028 


-.137 


. 109 




066 




Number of Minutes 
per Day 


-.036 


.111 


,002 


-.064 


-.133 




-.092 


(p< .05) 

Student/Student Level 1 


.069 


.071 


.043 


.044 


.050 




.050 


(iv: .05) - 








c 










EdExAG/Student Level 1 


.068 


.064 


.041 


.042 


.049 




.050 


. -SolutC. V 


■;Lue of the coefficient 


required for a 


correlation 


between 


two studi-nt- 


level varh 


ibk.s 


to be 




Liy signif Leant:- (a ~ . 05 


, two-tailed). 


Cue tO t^O 


large nur.be r of de;;r 


ees of frc'L 


idur.:, 


t \\ e 


c v i t i c a 1 r. 


/.Lie z = r/: where c = 
r r 


1 /■.:»' was used 
















aluo j i tl: a coefficient 


required" for a 


correlation 


between 


one studont- 


level varii 


ible 


(Pretest) 




:-L\G-levej \ariable to be 


s cat is ticaily 


significant 


(; « .05 


, two-tailed 


) — see. iiqut 


: t IGP. 


IV- \ for 



t'ae eo:;::utin ' formula. 



ote: For convenience, all coefficients in this table were truncated to three decimal places — set 
Tables V-I-20 through V-f-25 for rorrvlaf ions with live-plac-n aenirncv. 
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IAHU\ V-1-.1U 



Intunwrolarions anions tho Kov Analysis V;ir i i\b 1 t.>s — 
Cohort 1, Spring Lan;;uai;o Total Soon* Ainlysi.- 

[ r (*p .0 r >) - /)7h , k = 11' | 

i 1 1 ! 



1 i n- 



i 8 l 
r'D ; i 


. M '■ u ! 

i; . J : M 1 


j . a.: 


l. L 1 


. • ■ I : ■ 


• ; . i . . 
■ . ; j < 


'.H 


L . ! ! 1; . 






. 5 3 " s 


■\ hi 


' 'i >I 


j . i i ■ , i. 


iJi 


7.) 




■.. D W 


f. 'l 1 M 


u. lsi.it-; 


- J . I u 1 
•I'. 1.50 



, ju.a 

1 '.,0. 



ao7 



r.\iw. ,; v-i-.M 



Intiiri'orrolafiims ;u\\o\V:\ the Ki«y Analvsis V.iriabh-s — 
liiiljnrt 1, Sprint; !*»/>, ].an^ua;;r Tola! Srniv An.ilvsis 



r (n ,0V) , hlK! , k 



. 'I f ; - i, 



0 . tJj 5 3 J 



• ' * \> j ~] -1.2: 



. i.aa 



Q. 2(78 h 

- c . : j : j • 



\'/i.», 



r J . 1 7 -. i J 
- " , ? 1 ? : . ' 











- ^ . j j ; ; n 


- ( 


. I !> 1 1 i 








. i a ? , 


t . :' ' . i " 


- u 


. j j a i. 








. l : . '. 


o . a i j ti ; 




: ] >u 










a • i :u 


IJ 


( , ; / 'i 'j 










t. l/tia 


u 


7111/ 








ana-. 


-c.r.cu 


-0 


? i t, ^ V 




■ .'it.: 




. . l : i 


■? . 21 I U li 


-li 


I'OiilU 


. " i 1 ■ ; 










u 


* '3 U :r 










. : i i b ; 


(] 


aaw 


, ] 1 1 ! , 






. t "> j 


- ), ioli J 


• " J 


(J lj ( J 1 u 


. ; ; i ■. . 






, 3 l' i J ) 


i , u(j ico 


-0 


0 a 30^ 








. i j i : ^ 


- j . ij k ; j; s 


1 


[JQ0CI 




. • \ . 


. L) ■< L : ■ ' 1 


. h JilC; 


- ti . {; " . e j 


L 


'j 3 o r : ' 










i. , ■ 3 ( 3 , 




; - 1 7 L 




. a ; 






- i . : i : h m 


J 


d i 7 1 








. l >\ : 


• ,'^0.r 




(j u ii :i ,< 












II 


ia.u 










■0, ![l'J.'3 














iai3,': 


- J 


isii^ « 










'j.::«.sl 


-0 


38087 








:i jj. ;.,!' 




"0 


;• U 77 ■, 










j . o ; : ^ 


-u 


aia 








1 :"■!.'; 


■ j . o i f j : j 


"0 . 


;'it-';i 








3 T ,' . 


L TO! M 












a. H 


v . J 7 7 1 










■ ' . -1 '-. ,l ) 




\ IJI'ji! 
























. . i ' , . . ; 


0 ; " ' ' 














OH] ; 


























: a'.n 














i Q 9 1 1 . 
















- u . 0 G S E 










-.i.ni.:..!] -;) 




-0. lJUi.0 








"■/«'» t< 


'M/.'h g 




- 0 . 0 1 j i : ) 












ui:o 


-u.mi: 










■'.:.)■'.: -o 


I37PC 


-0. 








? . ? : f 1 ' ■ : 




00 7 U 


- 1. OiOitb 






'IT 




' . Vj o 


0 j ; D 


U.01UJ 












D ^i* l 3 


■P. 10I7h 












IWC 


0.OG2W 










-'O .... j - r > 


032 5b 


0.01755 






. J' ■■ 






p s : : i 


-0. 132 5L 












Cl>o > 5 


d.ibSU 












*c 


J.Li?!) 1. 










i 




a / j k > 
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TAB!,F. V-I-2!! 



hUercorrelnt inns ;mmv, the Key Analysis Variables -•■ 
Cohort ^, Spring Lan^ua^e Total Score Analysis 



r (}v .05) - .*0i , k 



rr 



r .1 



1.' .JO.- 



.in:; 



■ /".'■( '. 


ii. -j PI F 






r. 11 VI 








- . : t i 


: J • ' 


- J . 3 1 i :. I 






-•).-?:').' 


; ' t j i 


: J 1 :< 




■ : . i ^ j 






,; , j ; L 


"IF' 




5.3?*, 










' i ) !? I • i 




' . 1 " 


> ; . ii » 1 ! 1 






i. j J: ' 
r n * r j r 




. ' r ■ . 


1. '"!.'!■ ■ i 






: . niii 





: . i : .: i 



- 1. 1 . ■■ 



1 . : ■ ? ? \i ; : 

■ ■. ' ; ■ • : . ] . in i ' i 

>'.'.'!■■ , r'-ii 1? 

.-. (, 1-"' ' , 



■ 5 ■ ' 



:i. 



• ] ■■) 

















.:i l 








. ■") 1 !» -j J 


-i 




. j -j • : 




- 0 71 -»f 


(i 


. ; 4 fc ^ j 






- j 




ii 




- u 










n 


. fi 3 !: . «J 




4 7 / 4 J 


''.I-! 1M 


j 






. ?>:.w 




t J I 7 / 3 




i) 




) 


? 7 $7 1 


i). lf.d i ; 




.) 




i 


ii : 1 4 a 


-o 


<! / J-J ] 






4 < ) i ; 




6117/ 


0 








:>ti : m ) 






(j 


4 Jl.jJ, 




i 






J-JniJ 
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TAiU.i-: V- 1-2.6 



Commons Lity Coef f ie Lents *f or the Regression of Post test on SKS (S) 
Pretest (P), EdExAC Duumy Codes (I)) and Teacher Variables . .) -- 
Cohort i, Spring L9 72 , Lm-ua^e Total. Seore Analysis 



SES(S) 



Protest 
(P) 



KdExAc 

Dummy Codes (D) 



I eacher 
Variables(T) 



i:(X.) 
i 



C(S,P) 

c:(s,d) 
c ( s , r ) 

C(P,D) 
C(f\T) 

i ; < i) , t ) 
c(sj\n; 
C(s,r ,T) 

C(S,D,T) 
C(P,I),T) 
C (S J* J), T) 



.0 3468 

( .10-4-46) 

.0:384 6 
( . L 1386) 

.0684 1 
(.110610) 

.000 31 
( .001 34) 



.094 76 
(.2834?) 

.0 '384 6 
( . 1.1386 ) 



.00007 
( .00021 ) 

,0006 3 
( .00191 ) 

- 00 36;S 
f- .01 10 ( >) 



-.00190 
(- .0039 7) 



.002 34 
( .0076 3) 

.00026 
( .00080) 



. OOUO 7 
( .00021 ) 

.0006 ] 
f.OOl'-.l J 



.00! 2 * 
< .00 372) 

( -- . ()0" ) 



.09239 
(.2 789 3) 



.06841 
(.20610) 



.002 34 
(.00763) 



-.0072 7 
' - .0219.1 ) 

.0000 7 
( .00021 ) 



-.00368 
l -.01 109) 

.001 2 3 
(.00372) 

- .001 98 
( -.003° 7) 



-01072 
( .03229) 



.000 31 
( .001 34) 



.00026 
( .00080) 

_ .00727 
(-• .02 191 ) 



.0006 3 
(.00191) 

- .0036 8 
(-.01 109) 

.00123 
( .00372) 

-.00198 
( - .0039 7) 



i 3710 



0004 3 



,n,T) 



.331 94 



Pieli^w earn roriininna 1 i I v '•(>♦■ \ \ i ■* i rnt and in pa rent hescs is thr normalized 
eoff i" i o icnt . td.ai is, the eanr; >na 1 i t v oner" fir i ent divided hv R (S,P,i),T) 



!-29 



ERLC 



37 8 



t 



TAiil.i- 



Commonality Cocf f i r ienls* for the Kinross inn of Post test on SIvS (S), 
Protest (P) ^ MdHxAC Dummy Codes (0) and Te.acher Variables (T) — 
Cohort 1, Spring 197'), Lain;ua^e Total Score Analysis* 



SKS(S) Protest Kdl-xAi; learner 

0') Oummy Codes (D) Variables (T) 



.00337 .4M84 .0807*1 .001.78 

(.00497) (.684-58). (.11921) (.0026*3) 

C(S,iS .05497 .0*5407 

t .08.1 14) ( .081 1 +) 

C(S,!)) .00013 .00015 

(.00022) ( .00022) 

CfS/I) -.0001.7 -.00017 

(-.0002b) (-.0002(0 

C0M» .0577n .() I7 7fi 

( .0852m) f .OS52o) 

-<(1\T) .00828 . 00828 

( - 01 222 > ( .oi 222) 

(; 0Vr) .00248 .00248 

f.003nb) (.0036(5) 

C(S,P,D) -.01.1 72 -.0! ! /j -.01 i 

(-.01750) (-.01 730) ( -.01 7 id] 

C(S,I\T) --001 32 -.00] J2 -.001 32 

(-.00195) (.-.0019)) (-.0-51.95) 

^(S,I),T) .00148 .00] ', 8 .00)48 

f .00219) (.00219) (.00219) 

C:(P,D,T) .008/8 .00878 • .00878 

: " 01 -9 5 ) ( . 01295 ) ( .01295) 

{ C CS, D,T; .00702 .00702 . .00702 .00702 

(.OlO'Jh) I'.OjOjO) t.0;036) (.01036) 



K"l!\. 1 . 0) 37 7 , 5ri/til . i Vfwl .02833 
R" i S , P, i), 'H - .(i774f? 

* !k-!ow earls eommona I i ty onei f i r ient. and in parentheses is tho normalized 

roof fir ient, that is, the <\ uniru >n. 1 1 i t v reeffirient divided by K(S,P,D,T). 

:JV>) 

\ 

\ 



TABLE V-l-28 



-Commonality Coefficients* for the Regression of Posttest on SES (S) , 
Pretest (P) , EtfExAG Dummy Codes (D) and Teacher Variables (T) — 
Cohort 4, Spring 1972, Language Total Score Analysis 



i 




r re l cb c 
(P) 


EdExAG 

Dummy Codes(D) 


i eacner 
Variables (T) 


U(X.) 


.00241 
(. 00334) 


.48952 


( 


.02403 
.03336) 


.00269 
( nni7^ 

t, i Uw J / J / 


C(S,P) 


.04130 


.04130 








C(S,D) 


.00789 
( 01096} 




c 


.00789 
.01096) 




C(S,T) 


.00006 
( 00008} 








.00006 

\ . U U U U O ) 


C(P,D) 




.07254 

V . XUU / L ) 


c 


.07254 
.10072) 




C(P,T) 




.01865 
(.02589) 






.01865 
(.02589) 


C(D,T) 






c 


.00144 
.00199) 


(.00199) 


C(S,P,D) 


.05896 
(.08186) 


.05896 
(.08186) 


( 


.05896 
.08186) 




C(S,P,T) 


.00238 
(.00330) 


.00238 
(.00330) 






.00238 

(.00330) -r ; 


C(S,D,T) 


.00201 




/ 

\ • 


.00201 
.00279) 


.00201 
(.00279) 


C(P,D,T) 


V 


-.00420 
(-.00583) 




.00420 
.00583) 


-.00420 
(-.00583) 


C(S,P,D,T) 


.00057 
(.00080) 


.00057 
(.00080) 


(' 


.00057 
.00080) 


.00057 
(.00080) 


R 2 (X.) 


.11558 


.67972 




.16324 


.02359 






R 2 (S,P,D,T) = 


.72024 







*Below each commonality coefficient and in parentheses is the normalized 
coefficient, that is, the commonality coefficient divided by R*' (S , P , D ,T) , 
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V-I-31 



TABLE V-T-29 



Soinmonality Coef f icfents* for the Regression of Posttest m SES (S) , 
"Pretest (P) , EdExAG Dummy Codes (D) anJ Teacher Variables (T) — . 

Cohort 4, Spring 1973, Language Total Score Analysis 

i . 

/ 





SES(S) 


Pretest 
(P) 


■ EdExAG 

Dummy Codes (D) 


Teacher 
Variables(Tj 




T)0 1 Q 1 ' ■ 
• x y l. 

(.00.260) 


(. 74560) 


. U J j I u 
(.04 770) 


.00152 
(.00206) 


res P ) 


nift 7 7 

• U JO / /, 

(.05269) 


n 7ft 7 7 * 

(.0526:0 




f 


res n ^ 


. U U U J Z. , , ; 

(•-.0004*4)^ 


■ 


(-.00044) 




CCS T ) 


onm i / l - 
(. 00015). ( ' 






. UUU11 
(.00015) 


C(P D) 


■ ' 


ns 7 1 s 
(.07767) 


n s 7 i s 
(.07767) 




r fp 




Drifts i 

• UUOj J 

(.01160). 




. UUc ' - 


C(D,T) 






-.00065 
(-.00088) 


-.00i»': 

(-. 0008 - ; 


C(S,P,D) 


.04247 
(.05772) 


.04247 
(.05772) 


.04247 
(.05772) 




C(S,P,T) 


.00157 
(.00213) 


.00157 
(.00213) 




.00157 
(.00213) 


C(S,D,T) 


-.00015 
(-.00021) 




-.00015 
(-.00021) 


-.00015 
(-.00021) 


C(P,D,T) 




-.00123 
(-.00167) 


-.00123 
(-.00167) 


-.00123 
(-. 00167) 


C(S,P,D,T) 


.00242 
(.00329) 


.00242 . 
(.00329)* 


.00242 
(.00329) 


.00242 
1.00329) 



R 2 (X.) 


.08677 


.69330 


.13478 . 


.01211 








R*'(S,r,D,T) = 


. 73582 









*Below each commonality coefficient aid in parentheses is the normalized 
coefficient, that is, the commona^ y coefficient divided by R^(S,P,D,1). 

V- f- 32 
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TABLE Hj-30 • • 

Commonality Coefficients* for the Regression of Posttest on SES (S) r 
Pretest (P) , EdExAG Dummy Codes (D) and Teacher Variables (T) ~ 
Cohort 6, Spring 1972/, Language 'Total Score Analysis 







SES(S) 
- 


Pretest 
(P) 


; EdEXAG 
j, ^™ny Codes(D) 


Teacher 
Variables (T) 


• 

U(X 4 ) 


.0029 7 
(.00457) 


.56212 
(.86427) 


( 


.00493 


.00192 
(.00295) 


C(S,P) 


.02442 
(.03754) 


.02442 
(.03754) 








C(S,D) •. 


.00255 
(./)0392) 

.00005 
(.00008) 




( 


.00255 
.00392) 




C(S,T) 








.00005 
(.00008) 


C(P,D) 




.01691 
(.02600) 


(■ 


.01691 ? 
.02600) 




C(P,T) 




.00631 
(.00970) 






.00631 
(.00970) 


C(D,T) 






(. 


.000 36 
.00055) 


.00036 
(.00.055) 


C(S,P,D) 


.02013 
{ . u juy j ) 


.02013 
( . U 3095) 


(. 


.02013 
.03095) 




C(S,P,T) 


.00114 
(.00176) 


.00114 
(.00176) 






.00114 
,,(.00176) 


C(S,D,T) 


-.00105 
(-..00162) 




(- 


.00105 
.00162) 


-.00105 
(-.00162) 


C(B,D,T) 




-.00190 
(-.00292) 


(-■ 


.00190 
.00292) 


-.00190 
(-.00292) 


C(S,P,D,T) 


.00955 
(.01468) 


.00955 
(.01468) 


(■ 


.00955 
.01*468) 


.00955 
(.01468) 


R 2 (X.) 


.05975 


.63868 ■ 




.05147 


.01637 






R 2 (S,P,D,T) 


= .65040 





*Below each "commonality coefficient and in parentheses is the normalized 
coefficient, that is, the commonality coefficient divided by R" (S ,P,D,T) . 



v-r-3.3 
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TAB Lb*. V-l-31 



Commonality Coefficients* for the Regression of Posttest on SES (S), 
Pretest (P), L !£xAG Dummy Codes (D) and Teacher Variables (T) — 
Cohort 6, Spring 1973, Language Total Score Analysis 



SES(S) Pretest EdExAG Teacher 

(P) Dummy Codes (D) Variables (T) 



U(X.) 
1 


( 


.00113 
.00164) 


( 


.59885 
.87356) 


( 


.01175 
.01715) 


( 


.00172 
.00251) 


C(S,P) 


( 


.04001 
.05837) 


« 

( 


.04001 
.05837) 




• 






C(S,D) 


( 


.00067 
.00098) 






( 


.00067 
.00098) 






C(S,T) 


( 


.00003 
.00005) 










( 


.0000 3 
.00005) 


C(P,D) 






( 


.00276 
.00402) 


( 


.002 76 
.00402) 






C(P,T) 






(• 


.00330 
.00481) 






( 


.00330 
.00481) 


C(D,T) 










(-! 


.00149 
.00218) 


(- 


.00149 
.00218) 


C(S,P,D) 


(. 


.01903 
02776) 


(• 


.019Q3 
.02776) 


(! 


,01903 
,02776) 






C(S,P,T) 


('. 


0005 7 
00084) 




,0005 7 
00084) 








057 
00084) 


C(S,D,T) 


('. 


00010 
00015) 






(1 


00010 
00015) 


c 


.0010 
,00015) 


C(P,D,T) 






c 


00200 
00292) 


(.' 


00200 
00292) 


(! 


00200 
00292) 


C(S,P,D,T) 


('. 


00509 
00743) 


' (.' 


00509 
00743) 


('. 


00509 
00743) 


(" 


00509 
00743) 



R (XJ .06664 .67161 .03992 .01133 



R 2 (S,P,D ,T) = .68552 

*Below each commonality coefficient and in parentheses is the normalized 
coefficient, that is, the commonality coefficient divided by R ? (S ,P, D ,T). 

3 3 ) 



V-I-34 



Student/ ' 
Student 



HdHxAiV 
Student 



Correlations of All Key Analysis Variables with Posttest 
Language Total Score Analysis 



Level of 
Correlation 



Variable 



Socioeconomic Back- 
ground *' 1 

Pretest 

Teacher's Age 

Teacher's Socio- 
economic Background 

Teirhing Quali- 
fications 

Utilization of 
Objectives 

Individualization 
in Decision Making 

learner or Locally' 
Developed Materials 

Individual nation of 
Instructional Pact 

Scheduling 
Characteristics 



Cohort , 
SP72 



Ise of Perf 
Ac reunion ts 



a nuance 



Classroor,/rou;i 
iit^aniz/tion 

l^fnic IV: it 
\'orni'Sit!?:i 



.370 

.368 
.016 



13" 



.()]« 

.095 



.02] 



!'18 



Cohort 1 
SP73 



.23t 

.766 
,047 

•.111 



L2n 



.1177 



.008 



11-'. 



-.01 14 



■Ml 



■SP72 



.339 

.073 
.042 

.310 



.022 



- iiS8 



.in i 



\ 



4— 



Cohort 4 
SP73 



.294 

,835 
.053 

,082 
.018 
-.032 
-.042 
-.120 

-.125 



.047 



,112 



iort 
SP72 



.244 

.7^ 
-.104 

.052 
-.120 

.104 
■A)P 

M 

.043 



102 



015 



Cohort 6 
SP73 



T 



.258 



.819 



on. 



.033 



04 Q 



.043 



-.054 



)57 



.101 



023 



-,u}7' 

'continued) 



9 

ERIC 

™5Ti 



I- hi! (con tinned) 



Level of 
Correlation. 


Variable 


Cohort 1 
' SP72 


, Cohort 1 ' 
SP73 


'Cohort 4 ' 
SP72 


Cohort 4 
SP73 


Cohort 6 
SP72 

— ■ - n i 


. Cohort 6 
1 SP73 


EdExAG/ 
Student 


Completeness of / 
instructional Package 


.025- 


-.149 


.049 

• 


-,067 


.093 


-.019 




Utilization of Stu- 
dent Evaluation 


.1.05 


-.052 


.093 


-.086 


.104 


.059, 




Ha n Y&n r\ f T n rl i \i \ n 1 13 1 - 
IJcii L Ct: UI lUUlviUUcU 

ization 




-.100 


.049 


-.053 

I 

-.122 


.112 


.0-31 




Level of Innova- - 
ti'on 


086 


- 139 


.014 


.111 


'.022^ 




Number of Minutes 
per Day 


-.025 


, -.064 


.019 


.001 •• 


-.083 


-.146 


r(p "< .05) - ' 
Student/Student Level 1 


,069 


■ .071 


.043 


.044 


.050 


.050 


r(p '■' .05) - . 
EdExAG/Student,, Level' 


.065 


.066 


.040 


..042 


.0 .49 * 


.049 



Absolute value \ the coefficient required for a correlation between two student-level variables to be 
statistical? significant (-t > .0'3, two-tailed) . _ Due to the large number of "degrees of freedom, the • 
critical ratio i - ch where a = lA'N was used. 



2 Absolute value of tjie coefficient required for a correlation between one student-level variable 
an EdExAC-level variable to be statistically significant (a i .05, two-tailed)— see Equation IV- J for 
the computing formula. _ 

Note: For convenience, ail coefficients in this table were truncated to three decimal, places - see 
Tables V-I-20 through M-25 fur iwlaMons with live-place arctiracv. . , 




TABLE H-33 

, Correlations of the Key Treatment Variables with Posttest Residualized 
the Basis of Pretest and SES - Language Total Score Analysis 



Variable 


Cohort 1 
SP 72 


Cphort 1 
SP7? 


. Cohort 4 
SP72 


Cohort 4 
SP73 


Cohort 6 
SP?2 


Cohort' 
SP73 


Utilization of Objectives 


,061 


-.225 


-1 029 


-.039 


> .019 • 


-.057 


Individualization in Decision- 














Making 






002 


.064 


-.088. 


Teacher or Locally Developed 


,003 












Materials ■ 


-.048 


,010 


-.067 


.006 


-.034 


Individualization of Instruc- 














tional Pace 


.068 


-.048 


. -.067 


-.020 


.034 


-.088 


Scheduling Characteristics 


.121 


-.114 


-.].o: ; 


.003 


-.017 


.020 


Use of Performance Agreements 


.086 


-ii 068 


* U 1) v 




A 1 / 

-.014 

V 


-.053 


Classroor Croun Orcani'.iUnn 


iWjtl 


AW I 


-.062 


,083 ■ 


-.048 


.014' 


Teaching L'nit Composition 


073 

tit j 






-,(J ( J8 


.060 


-.123 


Completeness of Instructional 




-.168 










Package , f 


-.004 


-.033 


-.045 


•.043 


'-.087 


Utilization of Student Evaluation 


.078 


-;266 


;003' 


-.022 


.019 


r '~.026 


Deuree of f r *ii ir 1 : 1 ■ - ! ; "if inn 


n k c 


1 m 

-.197 


-.059 


' .036 


' .027 


-.079 


Level of Innovating 
> 


.079 


-.226 


-.058 


■ -.012 


.020 


-.073 


Number of Minutes per Dav 


.039 

. ml 


-.219 


.016 


' .105 


.067 


-.097 


r (p. • .05) - 

EdExi\G/Student Level 1 


.066 

• 


.065 


. .042 ■ 


.042 , 


.050 


.049 



'Absolute value of tin; coefficient required for a correlation between one stufa- level- variable fatten 
residual) and an EdEsAf- level variable to be statistically significant (. =.05, trailed)- ^f^ili 
h "'" rl " 1 ' "• v,,!,|itil - ! ' , ™ ,; »- Al! .•...rr-i .ii,,, h, this labl, ;i- dv.H^i c^la, i.-rs ' 
•.•■'"•'.•in.-..-, a! !-ovl Ileitis vvr, ! ni:v::!v c | y, :]„•,,■ ,!,,• ,v, | .,r.- llVSi 
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TABLE V-r-34 

Commonality Coefficients'- for the Level off I nnovnt ion Crowth Model — 
y Cohort 1, Spring 1972, Language Total Score Analysis 



Cpmmonality 
Coefficient 



SES(S) 



L("X. ) 

L 



C(S,I'-) 
•C(S,F.)_ 

c(s,n 

C(P, El 

C(P,T) 

C(E,T) 

CCS, P,E) 

C(S,P,T) 

C(S,E,T) 

C(P,E;T) 

C(S,P,E,T) 



N 
J 



.09463 
(.38450) 

.0 3946 
(.16035) 

..00798 
(.03241) 

-.00286 
(-.01164) 



-.00271 
(-.01102) 

.00043 
(.00175) 

. .00018 " 
(.00072) 



.00000 

(.aooo-i). 



,13710 



Pretest 
(P). 



.10435 
(.42401) 

.03946' 
(.16035) 



-.00502 
(-.02038) 

-.00074 
(-.0029?)' 



-.00271 
(-.01102) 

.0004 3 
(.00175) 



.oqo.20 

(.00083) 

.00000 
(.00001) 



13508 



EdExAC 
Variables 
and NMT.N(E)** 



. 00740 
(.03008) 



. 007^8 
(.03241 ) 



-.00 502' 
(-.02038) 



-.00037 
(.-. 001 52) 

-.002 7.1 . 
(-.01102) 



.00018 
(.00072) 

. 00(^0 
(.0008j>) 

.00000 
(.00001) 

L_ 



. 00766 



/ 



8 (S,P,E,T) - .24610 
IT (S,P;D,T) + = . 33194 



Teach i ng 
Qualifi- 
cations (T) 



.0031 7 
( .01289) 



- .00286 
(-'.01164) . 



-.00074 
(-.00299) 

-.00037 
(-.00152) 



.0004 3 
(t001 75) 

.00018 
(.00072) 

,00020 
(.00083) 

.00000 < 
(.00001) 



,00001 



* Below each' commonality 'coefficient and in ■ parentheses rs the normalized 
coefficient, that is, the commonality coefficient .divided by R ? -(S , P , E , T) . 

**LT and NMIN -are abbreviations for Level of Innovation and Number of' 
Minutes per Day. 

+ The multiple correlation squared of'posttest w i t \ } SES, pretest ho dummy 
variables encoding EdExAf, group membership and the three key teacher 
variables. * ) . ' ' 

■ \$'M) . ■ 



V- I - v- 



-Commonality Coefficients* for the I-evel of Innovation Crottth Made I — 
Cohort- 1 ,JSp ring 1.973, Lan.maa-ge Total/ Score Analysis- 



Commonality 
Coefficient 



SRS(S) 



Pretest- . J^tKxAC' u - 
(?) Variables 
.-.LI and SM1N ( K ) * 



U(X.) 



C(S,P) 

C(S,E) 

C(S,T^ 
» 

c(i>,F.)' 

C(P,T) 

C(E,T) 

0(S,P,P) 

C(S,P { T) 

O0S,K,T.) 

c(p,e,t) 



C(S",P,'E,T) 



. 00059 
(.6(1093) 

. (>64l'fi 
(.10065) 

00463 
(.00726) 

- . (100 0 7 
(-.00011)- 



*, . .5 32 70 

• f .83571 V 

• * .06416 

* (.10065) 



' -.02 364 
^-.03700) 

. 00964 
"(.01513) 

-. 00032 
(-.'00050) 



-.00.121 
(-.00190) 



-.001 34 
(-.00210) 

1 0059 3 
('. 00930) 



-.02-364 
(-.03709) 

.00964 . 
(.015 1 3) 



' . .00137 
(.00215) 

r -00] 21 
(-.00190) 



R-.CX.) 



■ .05377 



,58761 



..04425 
( .06943) 



.00463 
( .00726) 



-.00134 • 
•(-.H0210) 



■ .00057 
(.0Q089) 

-.'02 36*4 
(-.03709) 



- . 00032 • 
(-.0005(1)' 

.001 37 
(.00215) 

-.001,21 

(-.borpo), . 



02431 



; K\6S,.?,I-,T) = 
R 2 (S 1 P,D,T) + - 



,6374-* -. 
, 67746 



Teach fnti 
Oua'lif i- 
c air i ons (T) 

• .00017 
'(..00O26) 



-.00007 
(-.0001.1) 



.00593 
(.00930) 

.0005 7 
(.00089) 



. 00964, 
(.01513) 

..-.00032 ' 
' (-.00050) 

'-.00137 
>. (.00215) 

.-,00121 ' 
(-.00190)' 



*Below ea^b commonality coef f i ci ent > a.nd'/in parentheses is the normal i zed ~ 
coef f ieieilt , that is, the commonality coefficient di yidod by R 2 (S j P , T) . 
% **Ll and NMIN are abbreviations , t for Level of Tnnovatii i .and Number of ■ - 

Minutes per Day. . ' ' 

^The multiple correlation 'squared of ' pos t'te's t *'wtth SES, pretest / the dummy 
variables encoding EdExAC ^roup raembershtp and the throe key teacher 
variables . - — ' ' t , ^ 
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TABLE V- 1- 36 



Commonality Coefficients* 
Cohort 4 , Spring 


for 
1972 


t he Leve 1 
, Language 


oi ova t ion Growth Mode 1 — 
Total Score Analysis 


Commonality SliS (S) 
Coefficient * 


P 


ret est ✓ 

(P) 

i 


Frl FvAr 

Vari ables < 
rind NMIN(K) 


Teaching 
Oualifi- 
*.* eat ions (T) 


i'(X. ) .01376 
1 (.01981) 


( 


. 55944 
.80528) 


.00118 
(.00 170) 


.00135 
(.00194) 


C(S,P) . 10S'"> 
(.155 


( 


. 10809* 
. 15559) 






C(S,I0 -.00070 
f- .00101) 






-.00070 
(- .00101 ) 


• 


C(S, T) -.00056 
(-.00081) 








-.00056 , 
■ (-.00081) 


cn\ !■) 


( 


.001 18 
.00170) 


.001 18 
(.001 70) 




C(I\T) 


( 


. 01506 
.02167) 




.0.1 506 
(.02167) 


C( i;,T) 






.0001 1 
(.000] 5) 


.0001] 
(.0001.5) 


(' ( S , I', ) - . ; >f )i i.+ 5 
(■ .000.^0 




, 0UUn5) 


-.0004 5 
(-.00065) 




c(s,r,T) " >4 

f- . 0042 3) 


, 


,002^4 
.00423) 




-.00294 

/ fiA / ION 

(- . 004 2 3) 


usjvn ' - .00014 

(- . 00020) 






-.00014 
(- .00020) 


-.00014 
(-.00020) 


( ' ( \> i ■ t\ 

\ 


( . 


OOOM J 

00119) 


.0008 3 
(.00119) 


.00083 
(.00119) 


C(S,!\h;,T) -.00149 : 
(-.002] 4) 


(-! 


0014 9 
00214) 


-.00149 
(-.00214) 


-.00149 
(-.00214) 


R J (X.) . 1 15581 
i 




. 6 79 72 


.00052 


.01221 



ir(8,P;i:,T) ■= .604 72 
!^(S,P,D,T) + = .72024 



■ /; Keiov each commona 1 i Cy coefficient and in parentheses"*! 

coefficient:, that is, the commonality coefficient divid 
**!.! and NMIN are abbrevi at i nns for Level of innovation a 

Minutes per Dav. 
I The multiple correlation squared of'posttest with SI'S, 

variables encoding LdKxAC group menhersiiip and the th/e 

variables. 



s the normalized 
ed by K 2 (S,P ,F,,T) . 
nd Number o f 

p re tes t~ , the dummy 
e kov teacher 



-41) 



a ,o 2 



Commonality Coefficients* for the Level of Innovation Growth Model — 
Cohort 4, Spring 1973, Language Total Score Analysis 



Commonality 
Coef f i c ient 


SLS(S) 


. Pretest 
(P) 


LdExAO 
Variables 
LI and NMIN(E)** 


Teaching 
Ouali t i- 
cat ions (T) 


U(X ) 
i 


.00184 
(.00261) 


( 


.60599 
.86145)' 


.00346 
(.00491) ■ 


.00018 
(.00025) 


C(S.P) 


.07982 
(.11347) 


c 


.07982 
.11347) 






\.< v. > ' i 1 * / 


- .00039 
(-.00055) 






-.00030 




C ( S T ) 


.0001 3 
( .00018) 








.000] 3 
(.00018) 






( 


.0056 3 
.00800) 


.0056 3 
(.00800) 








( 


.00065 
.00092) 




.0006 5 
(.00002) 










- . O0002 
(-.00003) 


- .yooo: 1 

(-.00003) 


C(S ,1\K) 


.006 76 
(.00060) 


( 


.006 76 
.00060) 


.006 76 

(.oo<>fso) 4 




C(K,1\T) 


- . 00O9 2 


c- 


. 00002 
.00131) 




- . 000W2 
(- . 001 3 I ) 


C(S,L,T) 


-.0000 3 

C-.mno4) 






-j)00n 

(-.00004) 


-.0000 3 

r-. 00004) 


cn\ 

c(s,p,i:,t) 


-.0004 3 
f-.OOOh 1 ) 


< 


.00081 

.001L5) 

.0004 3 
. 000b J ) 


.00081 

(.001. 15) 

-.0004 3 
• 00061 ) 


.00081 
(.00115). 
-.00043 

nonfi] ) 


R 2 fX.) 

L 


.08677 




. MR 30 


.01 5 78 


.000 36 






ir fs, 


f\K,T) - 


. 70 346 








ir rs, 


P,D,T) + = 


.73582 







PjoIow ^nch commonality coot Tic lent and in parentheses is the normalized 
coefficient, that" is , the rorr.nona 1 i ty cot ■ LcLent divided by R- (S , P , F ,T) . 



"-LI and MM-IN are ahbrevi.at ions lor Level oi" rnnovntion and Number of 
Minutes per Day. 

+ The multiple correlation squared .off pnsttest v:ith SLS, pretest:, the dummv 
vari allies encoding IvL'.xAO group membership and the three kev t eat* her 
yar I ab les . 



TABLE V- 
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Commonality Coefficients* for the Level of Innovation Growth ModeJ-- ' 
Cohort 6, Spring 1972, Language Total Score Analysis 



Commonality 
Coefficient 



C(S,P) 

c(s,i;) 

CCS,!) 
C(!\K) 
C(P,T) 
C ( I- , T ) 
C(S J\L!) 



C(P,E,T) 
C(S,P,E,T) 



? 

R7X.) 
1 



SES(S) 



.00512 
(.00794) 

.0 3408 
(.05283) 

-.00057 
(-.00089) 

.OOOl'l 
( . 00029) 



. 009 51 
(.01474) 

. 00 329 
(.005 10) 

-.00022 
f-. 000 34) 



.00836 
(.01296) 



.05975 



Pretest 
(P) 

. 57693 
(.89445) 

.03408 
(.05283) 



EdExAC 
Variables 
LI and NM1N(E)** 



.0022 7 
< .00353) 

.00 308 
( . 004 77) 



.00951 
( .01474) 

.00 32° 
( . 00510) 



.00116 
( .00180) 

.00836 
(.01296) 



.00174 
(.00270) 



-.0005 7 
(-.0008^) 



.00227 
(.00 353) 



(.00004) 

. 00051 
r. 01474) 



-.00022 
'-.00034) 

.00116 
(.00180) 

.00836 
(.01296) 



.63868 



.02227 



ir(s,i\E/n 

lT(S,P,D,T) 



+ 



. 64 501 
. 65040 



Teach ing 
Qualif i- 
cations(T) 



.00006 
(.00009) 



.00019 
(.00029) 



.00 308 
( .00477) 

.00002 
(.00004) 



.00329 
(.00510) 

-.00022 
(-.00034) 

.00116 
•f? .00180) 

.00836 
(.01296) 



.01594 



* Re low each commonality coefficient ;\ml in parentheses is the normalized 

coefficient, that is, the commonality coefficient divided by R^(S,P,E,T). 
--Li and KMIN are abbreviation? for^evel of Innovation and Number of* 

Minutes per Day. ^ — 
+ The multiple correlation squared of post test vith SES, pretest, the dummv 

variables encoding Ed ExAfi proup membership and the three kev teaehor 

variab 1 es . 
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TABI.K V- I ~ i c ' 

Commonality Coefficients* for the Level of Innovation Grovth Model- 
Cohort 6, Spring 1973, Language Total Score Analysis " 



Commonality 
Coef f ic-ient 


SES(S) 


Pretest 
(P) 


EdKxAG 
Variables 
L L and NMTNfK)** 


Teaching 
Oual if i- 
. cntiojis(T) 


U(X.) 

L 


. ooom 

(.00137) 


. fS0708 
(.80/^-)) 

s 


.00)30 
(.00781) 


. 00013 
(.00020) 


c:(s,p) 


. 04891 


. 048 '1 
,072'LS) 






c(s,E) 


. 00095 
(.00140) 




. 00005 

( .00140) 




C(S,T) 
C(P,iO 


-.00007 
(-.00010) 


-.omv : 

(- . 0003 3 i 


-.00023 
f-. 000 3*3', 


-.00007 

'(-.OOOiO) 


C(P,T) 




.00012 
( . 00018) 




.000] 2 
( . 00018) 


C(K,T) 






- ..0001 3 

r-.Oooio) 


-.00013 . 
(-.0001 ( 0 


c(s,p.n 


.0137 3 
(.o'V) 2 3 ) 


.01373 
( . O'VP 'V) 


.01373 




C(S,P.T) 


- . 01)008 

r-. oool:i 


- . 00008 
( - . 000 j 2) 




- . 00008 
(-.0001?) 




. 000 j 1 
f . 0001 7) 




.oonn 

(. 000 17) 


.00011 
(.00017) 


C(P,M,T) 




- . 00008 
(-.00012) 


-.00008 

r-. 00012) 


-.00008 
(-.000] 2) 


C(S.P,i:,T) 


.0021 3 
( .00314) 


.00213 
..(.00 3.14) 


.00213 
. (.003.1.4) 


.002 L3 
(.00314) 



R *"(>;.) .0f-,hh4 . >S71H ■.02180 .00214 



\\~ (S, P, K,T"i - . h7S,94 



Helow each coronal itv coefficient nnd in parentheses is thc~""norma 1 i zed 
coefficient, that is, the coram on a 1 itv coefficient divided hv R : - (S J\ R , T) . 
'LI and MM F N are abbreviations for Level of [nnovat ion and dumber of 
M i nut es per Oav . 

The multiple correlation squared of nostto^t ,*ith SKS, pretest, the dummv 
variables encoding LdF.xAC g^oun rier.bership and the three kov teacher 
variables. 
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TABLE V-l-40 



Intercorre lat ions among the *?1 of Innovat ion Model Variables 
for the Cohort 1, Jr^'ng 197 3 Analysis Sample 



Variable Abbreviation 



va ria d ie 




Posttest 


SES 


Pretest 


LI 


NM1N 


TQ 


Post tes t 






.232 


.767 


-.139 - 


.064 


.127 


SES 




. 2 32 




.386 


.147 


. 175 


. 166 


Pretest 




.767 


. 386 




.021 


. 112 


.142 


Level of 
Innovations 




-.139 


.147 


.021 




.044 


.010 


Number of Minutes 
per Day 


-.064 


.175 


. 112 


-.044 




-.045 


Teaching Quali- 
f icat ions 




. 127 


.166 


.142 


.010 - 


.045 





V- 



TABLE V- 1-4 1 

Commonality Coefficients* for the Degree of Individualization Growth Model- 
Cohort .1, Spring 1972, Language Total Score Analysis 



Commonality 
Coefficient 



U(X.) 



C(S,P) 

C(S,.E) 
C(S,T) 

C(P,E) 

c;(p,t) 

C(E,T) 
C(S,P,FO 
•C(S,P,T) 
C(S,E,T) 
C(P,E,T) 
C(S,P.E,T) 



IT(X. ) 
i 



SES(S) 



.097f)9 
(.30939) 

.03859 
(.15777) 

.00491 
(.02009) 

-.00 317 
(-.01207) 



-.00184 
(-.00752) 

.000 54 
(.00222) 

.00040 
( . 00100) 



-.0001] 
(-.00046) 



. 13710 



Pretest EdExAG 

(P) Variables 
PI and NMIN(E)** 



. 10329 
(.42227) 

.03R50 
(.15777) 



-.0010 5 

(-.or6ib) 

-.00115 
(-.00470) 



-.00184 
(-.00752) 



.00054 

(.00222 



.000<S2 
(.00252) 

-.00011 
(-.00046) 



. 1 350M 



.00590 
(.02411) 



.00491 
(.02000) 



-.00305 
(-.01616) 



-.00101 
(-.00415) 

-.00184 
(-.00752) 



.00049 
(.00100) 

. 00062 
(.00252) 

-.00011 
(-.00046) 



.00500 



ir(S,P,E,T) 

ir(s,p,Lvn* 



.24460 
.33194 



Teaching 
Qualifi- 
cations (T) 

.00381 
(.01559) 



-.00317 
(-.01297) 



-.00115 
(-.00470) 

-.00101 
(-.00415) 



.00054 
( . 00222) 

.00040 
(.00199) 

.00062 
(.00252) 

-.0001] 
(-.00046) 



.00001 



* Below each commonality coeificl nt and in parentheses is the normalized 
coefficient, that is, the commonality coefficient divided by R 2 (S,P,E T) . 

**DT and KMIN are abbreviations for Degree of Individualization and 'Number' 
of Minutes per Dav. 

+ The multiple correlation squared. of pos ttest with SE<?, pretest, the dummy 
variables encoding KdExAfi group membership nnd the three key teacher 
var iabl es . 
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TABLE V- 1-42 



Commonality Coefficients* for the Degree of Individualization Growth Model- 
Cohort 1, Spring 1973, Language Total Score Analysis 





Commonality, 
Coefficient 


SES(S) 


Pretest 
(P) 


EdExAC 
Variables 
DT and NMIN(E)** 


Teaching 
Qualifi- 
cations (T) 



u(x 1 ) i 



c(s\p) ■ 

C(S,E) 
C(S,T) 

i:(p.e) 

C(P.T) 
C(E,T) 
c:(s j\n 
< S.1VD 

C(P,E,T) 
C(S,!\E,T) 



L 



.001)69 
(.00109) 

.06189 
(.09737) 

.0045 3 
(.00713) 

-.00008 
(-.00012) 



.54132 
(.85161) 

.06189 
(.0973.7) 



-.02.138 
(-.0336 i) 

.00952 
(.01498) 

-.00032 
(-.00050) 



-.00109 
(-.00171) 



-.00996 
(-.01566) 

.00609 
(.00958) 



-.02138 
(-.03363) 

.00952 
(.01498) 



.00121 
(.00190) 

-.00109 
(-.00171) 



.04247 
(.06682) 



\ 

.00453 
(.00713) 



-.00996 
(-.01566) 



.00057 
(.00089) 

-.02138 
(-.03363) 



-.00032 
(-.00050) 

.00121 
(.00190) 

-.00109 
(-.00171) 



.05377 



.58761 



,01603 



R"(S,P,E,T) = .63564 
R^(S,PJ),T) + = .67746 



.00017 
(.00026) 



-.00008 
(-.00012) 



.00609 
(.00958) 

.00057 
(.00089) 



.00952 
(.01498) 

-.00032 
(-.00050) 

.00121 
(.00190) 

-.00109 
(-.00171) 



,01607 



* Below each commonality coefficient and in parentheses is the formalized 
coefficient, that is, the commonality coefficient divided by FT(S,P,E,T). 

**DT. and NMTN are abbreviations for Degree of Individualization and Number 
of Minutes per Day. % 
The multiple correlation squared of posttest with SES , pretest, the dummy 
variables encoding EdExAC J group membership and the three, key teacher 
variables. 

398 

v*- r- if, 



if 

/ 



TABLE V- 1-43 

Commonality Coefficients* for the Degree of Individualization Growth Model- 
Cohort 4, Spring 1972, Language Total Score Analysis 



Commonality 
Coefficient 


SES(S) 


Pretest 
(P) 


EdExAC 
Variables 
DI and NMIN(E)** 


Teaching 
Qualifi- 
cations (T) 


U(X ) 
i 


.01386 
(.01995) 


.56158 
(.80808) 


.00142 
J (.00204) 


.00163 
(.00234) 


C(S,P) 


.10452 
(.15040) 


.10452 
(.15040) 




C(S,E) 


-.00080 
(-.00115) 




-.00080 
(-.00115) 




C(S,T) 


-.00077 
(-.00111) 


t. 




-.00077 
(-.00111) 


C(P,E) 




-.00096 
(-.00138) 


-.00096 
(-.00138) 




C(P,T) 




.01592 
(.02291) 




.01592 
(.02291) 


~(e,t) 






-.00017 
(-.00025) 


-.00017 
(-.00025) 


C(S,P,E) 


.00312 
(.00449) 


.00312 
(.00449) 


.00 312 
(.00449) 




C(S,P,T) 


-.00450 
(-.00648) 


-.00450 
(-.00648) 




-.00450 
(-.00648) 


C(S,E,T) 


.00007 
(.00010) 




.0000 7 
(.00010) 


.00007 
(.00010) 


C(P,E,T) 




-.00003 
(-.00005) 


-.00003 
(-.00005) 


-.00003 
(-.00005) 


C(S,P,E,T) 

9 


.00008 
(.00011) 


.00008 
(.00011) 


.00008 
(.00011) 


.00008 
(.00011) 



R (X.) 
i 



11558 



.67972 



.00272 



ir(S,P,E,T) = .69496 
R*~(S,P,D,T) + = .72024 



.01.22.1 



* Below each commonality coefficient and in parentheses is the normalized 
coefficient, that is, the commonality coefficient divided bv R 2 (S P E TV 

**DI and NMIN are abbreviations for Degree of Individualization and dumber 
or Minutes per Day. 

+ The multiple correlation squared of post test with SES, pretest, the dummv 
variables encoding EdExAC group membership and the three kev teacher 
variables. 
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TABLE V-I-44 

Commonality Coefficients* for the Degree of Individualization Growth Model — 
Cohort 4, Spring 1973, Language Total Score Analysis 



Commonali ty 
Coeff icienc 


SES(S* 


Pretest 
(P) 


EdExAC 
Variables 
DI and NMIN(E)** 


Teaching 
Oualif i- 
cat ions (T) 


U(X.) 


.00192 
(.00273) 


.61407 
(.87213) 


.00410 
(.00583) 


.00012 
(.00017) 


C(S,P) 


.08511 
(.12088) 


.08511 
(.12088) 






C(S,E) 


-.00047 
(-.00067) 




-.00047 
(-.00067) 




C(S,T) 


.-00011 
(.00015) 




\ 


.00011 
(.00015) 


C(P,E) 




-.00245 
(-.00348) 


-.00245 
(-.00348) 




C(P,T) 




.00116 
(.00165) 




.00116 
(.00165) 


C(E,T) 


j 




.00003 
(.00004) 


.00003 
(.00004) 


C(S,P,E) 


,00147 
(. 00209) 


.00147 
(.00209) 


.0014 7 
(.00200) 




C(S,P,T) 


-.00122 
(-.00173) 


-.00122 
(-.00173) 




-.00122 
(-.00173) 


C(S,E,T) 


-.00001 
(-.00001) 




-.00001 
(-.00001) 


-.00001 
(-.00001) 


C(P,E,T) 




\ .00030 
(.00042) 


.00030 
(.00042) 


.00030 
(.00042) 


C(S,P,E,T) 


-.00013 
(-.00019) 


-.00013 
* (-.00019) 


-.00013 
(-.00019) 


-.00013 
(-.00019) 


R 2 (X.) 

1 


.08677 


.6983Q 


.00284 


.00036 



R 2 (S,P,E,T) = .70411 
R 2 (S,P,D,T) + = .73582 



*"'Below each commonality coefficient and in 'parentheses is the normalized 
coefficient, that is, the commonality Coefficient divided by R 2 (S,P,E,T). 

**DI and NMIN are abbreviations for Degree of Individualization and Number 
of Minutes per Day . 

+ The multiple correlation squared of posttest with SES, pretest, the dummy 
variables encoding EdExAC group membership and the three kev teacher 
variables . 
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TABLE V-I-45 

Commonality Coefficients* for the Degree'of Individualization Growth Model — 
-Cohort 6, Spring 1972, Language Total Score Analysis 



Comnona li tv 
Coefficient 


SES(S) 


Pretest 


EdExAC 
Variables 
01 and NMTN(E)** 


Teaching 
Oualifi- • 

r* m t" "i nnQ i Tl 

L. u L -LUlio ^ i. ) 


LKX.) 


.00505 
(.00783) 


,57600 
(.89296) 


( 


.00177 
,00275) 


,00005 

\ • WUwUO } 


C(S,P) 


.03398 
(.05268) 


.03398 
(.05268) 


• 






C(S,F.) 


-.00050 
(-.00078) 




(- 


.oooSo 

,00078) t 




C(S,T) 


. 000J9 . 
(j 00029) 








.00019 
. U1JUZ7 ) 


c(r.E) 




.00320 
( 00496") 


( 


.00320 
.00496) » 




C(P.T) 




.00307 
(.004 76) 






.00 30 7 


C(f..T) 






( 


.00003 
.00005) 


.00003 ' 

( (\C\C\{\^\ 
\ . wiJwiJj ) 


C(S, !',!•) 


.00^61 
(.01489) 


.0006 1 
(.01489) p 


( 


.00961 
.01489) 




C(S.P,T) 


.00 342 
(.00530 J 


.00342. 
(.005 30) 






\ .00342 
(,00530) 


C(S,K',T) 


-.00022 
(-.000 34) 




r- 


.00022 
.00034) 


" -'.-00022 
(-.00034) 


C(P,E.T) 




.001'Lh 
( .00181) 


( 


.001.16 
.00181) 


■ .00116 
(.00181) 


C(S,P,E,-T) 


.0082 3 
(.01276) 


.0082 3 ' 
(.01276) 


( 


.00823 
.01276) 


,00823 
(,01.276) . 


FT C\.) * 
l 


.05^75 


. 6 3868 




. 02 32° 


.01594 






R 2 (S,P,E,T) = 
!-rtS,P, l).T) + = 


\ 64505 
. 65040 





* Below each commonality coefficient and in parentheses is the normalized 
coefficient, that is, the commonality coefficient divided by R 2 (S , P , F. ,T) . 

**I)T, and MM! N are abbreviations for Decree of Individualization and Number 
of* Minutes per Day. 

+ The multiple correlation squared of posttest with SES , pretest, the dummv 
variables encoding KdExAd group membership and the three kev teacher 
variables. 
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TABLE V-I-46 

Commonality Coefficients* for the Degree of Individualization Growth Model- 
Cohort 6, Spring 1973, Language Total Score Analysis 



Commonality 
Coef f i cient 


-4 

SESfts) 


Prefest 
(P) 


, m EdExAG 

Variables 
ul ana iNrlllN (JW 


Teaching 
Oualifi- 
cat i ons ( i ; 


V " ' . ) 
l 


..00100 
( nm a 7 ^ 

^ . uum / ) 


.^0.725 

( q o /. 7 n ^ 
\ . oyti /u) 


.00517 ' 
( . 00762 ) 


.00004 
( . 00006) ' 


C(S,P) 


.04785 
( 070AQ") 


.04 785 






C(S,E) 


.00088 
( 001 3Q") 




.00088 

^ . UU± JU ) 


• 


C(S,T) 


-.00002 
■ (- 00004 V 






-,00002 

/ r\r\r\r\ f \ 

(-.()0004) 


C(P,F.)' 




-.00039 

\ • \JVJ\J J 1 ) 


-.00039 

\ • \)yi\jj / ) 




C(P,T) 




.00008 , 
( . 00012) 




.00008 
V . UUl Jl 2. ) 


C(E,T) 






».oooo4 ; 

\ . UUUUn ) 


-.00004 
( - . UUUUn ; 


C(S,P,E) 


.01482 
r. 02183) 


.01482 
(-.02183) 


.01482 
(.02183) 




C(S,P,T) 


-.00007 
(-.00011) 


-.00007 
(-.00011) 




-.00007 
(-.00011) 


C(S,K f T) 


.00007 
(.00010) 




. 00007 
(.00010) 


.00007 
.(.00010) 


C(P,E,T) 




-^.00004 
(-.00006) 


-.00004 
■ (-.00006) 


-.00004 
(-.00006) 


C(S,P,E,T) 


■ .00213 
(.00313) 


.00213 
(.00313) 


.00213 
(.00313) , 


.00213 
(.00313) 



R (X.) .06664 .67161 ' .022oO .00214 



R 2 (S,P,E,T) = .678,71 
R~(S,P,D,T) + = .68552 



* Below each commonality coefficient and in parentheses is the normalized 
coefficient; that is, the commonality coefficient divided by R 2 (S,P,E,T). 

**DI and NMTN are abbreviations for Degree of Individualization and Number 
of Minutes per Day. 

+ The multiple correlation squared of post test' with SES, pretest, the dummy 
variables encoding EdExAG group membership and the three key teacher 
variables. 4 
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TABLE V-I-47 








Regression Coefficients for the 
Language Total 


.Level of Innovation 
Score Analysis!" 

•. 


Growth Model - 


Cohort ?osttest 
Yiear 


i L.fc-U H I w r 


r 

i 


a 


. . 

P 


F 


1 V mo 
1 pr/l 


• SKS 


.37 


2. 04 


-.32 


* 




Prei-s 


. . 37 


1. 97 


,33 


108. 10 




Level of 
Innovation 


.09 


1 . 18 ' 


. 08 


A 

6 16 


- 


NMlrt 


• -.03 


. 11 


.05 


2.15 




TQ 


. 00 


-.46 


-.06 


3.29 








. 32 


(df 


= 1; 781) 




c \- c 

ShS 


. 23 ' 


-. 19 


-.03 


1 . 22 




i r o c c s c 


. / / 


.83 


.80 


1100.43 


m 


Level of 
Innovat i on 


14 


-3. 30 


-. 16 


SO LL 




MM IN 


- Ofi 


w 


-.16 


* 

47.47 




TO 


• 13 


.14 


.01 


/ .35 




(Constant ) 




. 6 7 


(df 


= 1- 749) 


. 1 1 / Z 
/ 


C 1~" c 


. 34 


. 96 


.13 


89.67 




Pretest 


8 2 


.91 


. 79 


3644. 95 




Level of 
Innovat i on 


. 01 


• JO 


— . U.j 


£ ' ~7 "7 

0.7/ 




XMIN 


.02 


.05 


. 0 2 


1.60 




.TQ 


. 11 


,36 


.04 ■ 


8.77 




(Constant) 


-46 . 


OA 


■ (df 


= 1; 1989) 


4 . S P 7 3 


SES 


.29 


'. 35 


.05 


* 

11. 74 




Pretest 


. 84 


.87 


.83 


3^74.59 * 




Level of 
I nnovat i on 


-.12 


.13 


.01 


.23 




>:>u:: 


. Of) 


. 17 


.06 


21.68 * 




TO 


. 02 


-.14 


-.01 ' 


.1.14 




(Constant ) 


' 56. 


07 


(df 


= 1: 1896) 



(cont i nued) 
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TABLE V-l-47 (continued) 



Cohort 


f — 

Posttest ' 

Year 


Predictov 


j 

r 




B 


M 


F 


6 ' 


SP72 




.24- 




'■• 3 


.08 


21.42* 






Pretest • 


.80 ■ 




..90 


. .79 


2413.46* 


- 




Level of 
Innovation * 


. 11 




; .05 


. 00 


04 






NMIN . 


-.08 




.34 


.05 


6.59* 






TQ 


-.13 




-.08 


-.01 


.23 






(Constant) 




15. 


23 


fdf 


= 1" 1485) 


" 6 


SP73 


ses 


.26 




.29 


.04 


4.34 1 ' 






, pretest 


\ 82 




.89 


.81 


2837 . 35 >V 






Level of 
Innovation 


.02 




-.75 ■ 


-.04 


* 

7.34 






NMIN 


-.15 




-.63 


-.06 


15.98* 






TO 


-.05 




. 15 


.01 ' 


.62 






(Constant ) 




78, 


.90 


(df 


= 1; 1501) 



Notation and abbreviation: 

r = zero-order correlation with posttest 

B - raw score regression coefficient 

li = standard score regression coefficient 
F = conventional K test of tin 1 regression coefficient 

NMIN =f EdExAG scale, Number of Minutes per Day (spent on language arts) 
TO = teacher scale, Teaching Qualifications 



\ 



x p = .05 



4 0 i 
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TABLE V- 



Regression Coefficients for the Degree of Individualization Growth Model 

Language Total Score Analysis^ 



Cohort 


Pos tt es i 
Year 


Predictor 


r 




B 




F 


1 


SP72 


SES 


.37 




2.06 


.32 


101.00* 






Pretest 


. 37* 




1. 96 


.33 


106. 79* 






Degree of Indi- 
vidualization 


.07 




2.44 


.07 


* 

4.79 






NMIN 


-.03 




.OH 


.04 


1. 32 






TQ 


.00 




-.51 


• -.06 


vV 

3.94 






(Constant ) 


- 


32. 


76 


(df 


— x . /Ox} 


1 


SP73 


■SKS 


.23 




-.20 


-.03 


1.42 






Pretest 


.77 




. 84 


.80 


1112.76* 






Degree of Indi- 
vidualization 


-. 10 




7.12 


-.IV 


46. 52'' 






NMIN 


- . Ob 




-.33 


-.17 


53.93 






TO 


.13 




. 14 


.01 


.35 






(Cons tan t ) 




15. 


26 


. tar 


= "1 • 7 /• Q ^ 
= 1 . / *t v ) 


U 


S P 7 ?. 


SES 


. 34 




. 96 


. 13 








Prut est 


. 82 




.91 


.79 


3661.81* 






Degree of Indi- 
vidual izat inn 


.05 




1 . 53 


-.04 


8. 36* 






NMIN 


.02 




. 04 


.01 


1. 36 






TO 


.11 






.04 


10.60* 






(Constant ) 




50. 


55 


(df 


= 1: 1989) 


u 


SP73 


SFS 


. 29 




. 36 


.05 


12. 30* 






Pretest 


.84 




. 87 


. 83 


3034.81* 






Degree of Tndi- 
v i dual izat i on 


■ . 05 




1 . 29 


.03 


* 

4.37 






NMIN 


. 00 




.18 


.06 


24.03* 






TO 


. t»2 




-. 11 


-.01 


. 79 






(Constant ) 




44. 


55 


(df 


= 1: 1896) 
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(continued) 



v - r - » J , 



TAHLK V- I -4S ( com i nm-d ) 



Cohort 



Posttesl 
Year 



i rfc:ciiL.uur 


r 






r 


RES 


.24 


.63 


.08 


■ 21.12* 


Pretest 


.8c 


.90 


.79 


2409.81." 


Degree of Indi- 
vidualization 


.11 


.30 


.01 


. 18 


NMI.N 


.08 


.33 


OS 


* 

6.24 


TO 


.13 


- . OS 


- .01 


.21 



SP7 



(Constant ) 



•15.48 



(df = 1; 1485) 



SP73 



Pretest 



.26 
.82 

".03 



Degree of Indi- 
vidualiza t i on 

WMIN -.15 

TO -.05 

(Cons tant 



.31 
.80 

-1.72 

-.59 
.09 

79. ii 9 



.04 
.81 

-.04 

-.06 
.01 



4.66 
2836. 96' 

6.73 

13.66 ' 
.19 



(df = 1- 1501 ) 



^-Notation and abbreviations: 

r - ze ro-orde r cor re La t ion with pos t tes t 



B = raw score regression coefficient 
B - standard score ^egression coefficient 
F = con ven t i nna 1 K test oif i\\ e re i; res s i on riK' ft" i c i »«n r . 
N'MIN = EdExAG scale, Number of Minutes per Day (spent on language arts) 
TO = teacher scale, Teaching Qualifications 
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TABLE V-J-49 

Comparison of Key Analysis Variables 
Jfor Positive .and Negative Outlier EdExAC Groups — 
Cohort J, Spring 1972, Language Total Score Analysis 



V a r 1 ali Le 




( I rea te s t 
Negat ivl? Out! iors 




I 


Greatest, 
osi t ive Out lie rs 


•Number of Students 




L8 








7 3 




43 


32 


Post tesjt Res id- 
ualized for Pre- 
test and SESv 


X 
SD 


-39.49 
46.03 


; 

-40. 
35. 


71 1 

i 

L 1 j 


2J 
j 49 


.87 

.65 


L7. J9 
50. 54 


15.39 
33.30 ; 




H ! 


-0.24 


-0. 


45 j 


0 


.04 


0.11 


0.10 


! Pretest (Nat tonal 
j Norm MA -=8 5) 

i 


X 

sn 


9fc>.02 ; 

j .10.24 


84. 
11. 


6 3 ; 

i 

94 ; 


! 94 

! 9 

t 


.69 
.50 


96.62 
9. 14 


93.75 
10.93 


t 

; ? 


g 


j ' -0. 10 


-0. 


0 3 1 


-1 


.42 


-0.77 


-0.88 


i 

i Posttest Intor- 
j po i a ted National 
i Norm- 32 L. 5) 


X 
Sij. 


292.36 
5 J . 80 


2 58. 
, 29 . 


57 


! 35 7 
: 52 


. 18 
86 


353.61. 
56.84 


336.8 3 
36.92 


i 
j 




; 0.34 


-0. 


48 


0 


00 


0. 50 


0. 38 


| SES 

t 

\ / 


X 


96. 78 


91 . 


34 


; 99 


73 


98.47 


9 3. 78 


sn 


7.9 1. 


5 . 


86 


9, 


2 5 


6. 50 


8.73, 


! 

; / 




0.98 


-1 . 


1.6 


-0. 


02 


0. 76 


0.02 


i 

j Ethnic Gr 
i (white=l; 
white=0) 


X 


0. 50 


0. 


64 


0. 


99 


0.81 


0. 56 


Sex* 

(girl=l; boy=0) 


x 


0 . 56 


0, 


64 


0. 


56 


0.44 


0. 56 


Utilization of 
Ob j ec t ives 




3.00 




n j 


3- 


00 


3 . 00 


3.00 


ind Iv idua 1 i za Lion 
in lieci.dLon Making 


- - - J 


L . 00 




i 

..Jl 


1 . 


00 


1 .00 


1 .00 

(coin i.nued2_ 



* Index of .nkewnes^. 



For b i na r y c. od e ri v ; i r: in I. 
proportion of s t u*l*-:?:L :-; 



v >■ - 



y where o skovmess imU- 
x 



the X l:i equal ' o Lht 
eroded with a "1." 

V- 1-55 



N = 



deviation of a score 
from X, where X is an 
EdExAG-group mean for 
var iab l.e X, and. 
number of students. 



ERLC 
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TABLE V-I-49 (continued) 









Variable 


* Greatest 
Negative Outliers 


Greatest 
Positive Outliers 


Tefacher or Locally 
Developed Materials 


i 

j. . 


uu 


9 nn 
z . uu 


i 

j. . 


^n 
jU 


i nn 
J. . uu 


± ■ 


sn 

JU 


Individualization of 
Instructional Pace 


o 

<_ ■ 


nn 
uu 


i nn 
J. . uu 


3 


^05 

r 


? nn 

£. ■ uu 




no 

VJV. 


Scheduling Charac- 
teristics 


1 

J. ■ 


nn 
uu 


i nn 

J. . uu 




nn 
uu 


i nn 

J. ■ UU 




nn 

VJ VJ 


Use of Performance 
Agreements 


1 

J. ■ 


nn 

uu 


i nn 


9 


nn 

VJVJ 


i on 

-L a VJVJ 


j 


no 

VJVJ 


Classroom Group 
Organization 


9 


nn 

uu 


? nn 

z. ■ uu 


9 


nn 

VJVJ 


i nn 

J ■ VJVJ 


j 


VJVJ 


Teaching Unit 
Composition 


2. 


50 


2.00 


1 


.50 


2.00 


2 


.00 


Completeness of 
Instructional Package 


2 


00 


1.50 


3 


.00 


1.00 


2 


.50 


Utilization of 
Student Evaluation 


2 


00 


2.67 


2 


.00 


' 2.33 


3 


.00 


Level ol : Innovation 


17 


50 


16.50 


22 


.00 


. 17.33 


25 


.00 


Degree of Individual- 
ization 


6 


00 


5.67 


8 


.00 


6.33 


10 


.00 


Number of School Days 
per Year 


180 


.00 


180.00 

4 


180 


.00 


180.00 


180 


.00 


Number of Minutes 
per Day 


90 


00 


105.00 


90 


.00 


120.00 


70 


.00 


Number of Teachers X 


4 


00 


1.00 


1 


.00 


2.00 


1 


.00 


Teacher's Age X 


29 


.50 


24.00 


25 


.32 


35.00 


46 


.88 


Teacher's Socio- X 
economic Background 


110 


35 


117.86 


108 


.32 


104.78 


95 


.05 


Teaching Quali- X 
f ications 


89 


,91 


86.49 


87 


.74 


100.29 


108 


.05 
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TAHI.K V--E-50 



Comparison ot : Key Analysis Variables 
: or Positive and Negative Outlier KdExAG Croups-- 



Co hor t 


I , 


Spring 197], l.an^ua^e ' 


ro t a 1 


Score Ana lysis 


Var iab 1 e 






Great est 






! Greatest 








; Ae^at i ve (hit 1 


i » 1 rs 




' Positive Out 1 


i o rs 


Number of St urfent s 




2 3 

\ 


80 


I 


3 


35 2 3 


(*} 


Post test Resid- 


X 


! -9.54 


-18.98 


_2 


68 ' 


30.41 26.89 


24 . 1 5 


ual ixocl for Pre- 


SD 














test and SKS 


| 45.13 


36. 18 


40 


.21 ; 


49.59 52.51 


36. 54 




i 

g * 


j -0.39 


-0.27 


-1 


21 i 


0.41 0.47 


0 .69 


Pretest (Nat ional 


X 


' 288.99 


348.64 


3 56 


25 


299 .64 310. 56 


34 5.63 


Norm=327) 


sn 
















60.06 


5 5.18 


62 


30 : 


60. 12 64. 81 


6 5.53 






-0.0 J 


0.26 


0 


06 


-0.85 0.56 


-0 .08 






i 












! Post test (Xat iona 1 


X 


j 3 54. 3 5 


387 . 40 


388 


08 


: 404.82 Vl0.48 


437 .69 




SL) 










1 { 




| Norm=382 ) 


72.39 


6 5.55 


63 


35 ; 


, 74. 14 ^Ur. 50 


58.73 






I 0.08 

i 


0.23 


-0 


3i : 


j ' 0.11 0. 39 


0.22 


At tit uile t'ownrd 


X 


i 


10 2.98 


101 . 


35 | 


i 


99 .4 3 


Language Art s 


SI) 










i 
1 




Si' 7 3 




] o . i 7 


i 0 . 


2 m : 




1 1 .66 








-0.68 


-0. 


32 




-0,12 


, SKS 
1 


_ 

X 


I 97.81 


111.81 


104. 


01 


j 94.61 94 .46 


9 3 . 10 


i 




; 8.62 


2.91 


9 . 


29 


7.60 9.10 


5.18 






0.9 5 


-0.73 


-0. 


44 : 


0.38 0.07 


1 .04 


; Ethnic Group' 


X 


! 0.61 


1 .00 


0. 


86 


0.4 5 0.74 


0.95 


, (wh i t e= 1 ; non- 
















white=0) 




! 






I 






Sex' 


X 


0.43 


0.51 


0. 


61 


0.70 0.48 


0 . 39 


(girl.= l ;boy=n) 




i 








(c 
















on t i nued ) . 


1 1 n d e : ■: o f sic e v; 1 i c s .' ; ) ; \ ■ 

N 

" ■ ....... 

''Tor binary rod^d variable:- tlie X i r; eqm 
proportion of students coded w L Ll i a "1." 

-Note: Blank entries indicate no data eol 


, when 

1 in the 
locted . 


1 y, " nkewness index, 

x = deviation of a score 
t/om X, where X is an 
EdExAG-group mean for 
variable X, and 

N = number of students. 
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TABLE V-I-50 (continued) 









Variab les 


Greatest 
Negative Outliers 


Greatest 
Positive Outliers 


Utilization of . 
Obj ect ives 


3. 


00 


3. 


00 


3. 


00 


1.00 


3.00 


1.00 


mdividualizat ion 
in Decision Making 


3. 


00 


1. 


00 


1. 


67 


1.00 


- 1.00 


1.00 


. Teacher or Locally 
Developed Materials 


1. 


00 


1. 


50 


2. 


00 


2.00 


1.50 


2.00 


Individualization of 
Instructional Pace 


3. 


00 


3. 


00 


2. 


00 


2.00 


3.00 


2.00 


Scheduling Charac- 
teristics 


3. 


00 


1. 


00 


2. 


00 


1.00 


2.00 


1.00 


Use of Performance 
Agreements 


2. 


00 


1. 


00 


2. 


00 


1.00 


1.00 


1.00 


Classroom Group 
Organization 


3. 


00 


2. 


00 


2. 


00 


2.00 


3.00 


2.00 


Teaching Unit 
Composition 


1. 


50 


2. 


00 


3. 


00 


1.00 


1.50 


1.00 


Completeness of 

Instructional 

Package 


2. 


50 


3. 


00 


2. 


00 


1.50 


2.50 


1.50 


Utilization of 
Student Evaluation 


1\ 


67 


2. 


67 


3. 


00 


1.00 


2.00 


2.33 


Level of Innovation 


23. 


67 


20. 


17 


22. 


67 


13.50 


20.50 


14.83 


Degree of Indiv- 
idualization 


9 


67 


7 


67 


8. 


67 


5.00 


7.00 


6.33 


Number of School 
Days per Year 


180 


00 


176. 


00 


200 


00 


180.00 


180.00 t 


180.00 


Number of Minutes 
per Day 


50 


00 


115. 


00 


150. 


00 


50.00 


100.00 


90.00 


Teacher/Student 
Contact Ratio 3 


3. 


60 


3. 


04 


6 


67 


3.87 


3.56 3.45 
(continued) 



Relative measure of teacher/student contact equal to the percent of teacher 
time per individual student 

V-I-58 
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TABLE V-I-jO (continued) 



\7 n y "i nK 1 o 
VUL J. ci U LL 






Greatest. 
Negative Outliers 






Grea test- 
Positive Outliers 


.=] 


Number of. Teachers 


X 


1 


.00 


— - — ' — r 

1 .00 


i 


.00 


1 


.00 


1 .00 


1 


.oo ; 


'Teacher's Age 


X 


30 


00 


30.00 


35 


3 1 




.00 


24 .00 


30 




Teacher's Socio- 
economic Back- 
ground 


X 


111 


.67 


114.65 


96 


.M 


108 


.04 


98.24 


91 


26 

; 


Teaching Qualifi- 
ca t ions 


\ I 


100 


12 


104.15 


101 


t 

20 


109 


.96 


102.60 


100 


29 




- 1 























\ 



4ii 
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TABLE V-I-51 

Comparison of Key Analysis Variables 
for Positive and Negative Outlier EdExAG Groups- 
Cohort 4, Spring 19 72, Language Total Srorv* Analysis 































Var iabl e 






Greatest 
Negative Outl 


i ers 


T 
i 
\ 


Pos 


Greatest 
i t i ve Hiil" 1 


i c r s 




Number of Students 










23 




19 




10 




56 


49 


Post test Resid- 
ua lized for Pre- 
Lest a no bhr> 


X 

SD 


-20 

26 


.90 
.27 


-34 
58 


.86 
.85 


-52 
41 


.73 
.48 


1 

; 33 
i 


7 9 

-77 


28 
36 


.06 
.47 


on 

35 


.42 


i 


g 1 


0 


. 26 


-0 


.97 


-1 


.45 


■ o 


.51 


0 


.03 


n 

U 


• Dp 


j Pretest (National 
i Norm=422) 


x 

SD 


55 


. 30 
.31 


454 
62 


. 19 
.38 


436 
67 


.37 
.92 


i 452 


. 20 
• / o 


501 
42 


.81 
.07 


446 


.08 

. U j 




g 


-0 


. 4 1 


-0 


. 30 


-0 


.08 


-0 


n s 


-0 


.06 


n 
u 




Posttest (Nat ional 
Norm=461) 


X- 
SD 


470 
59 


.60 
.76 


448 
75 


.32 
.95 


4 20 
67 


.57 
.22 


49 


. JD 

.61 


573 
48 


.08 
.52 


j4 


. J J 
. JO 




g 


0 


.37 


-0 


.73 


0 


.23 




.19 


0 


.19 


0 


. 12 


Attitude t~ n uj i r H 


v 
A 




.36 


104 


.06 


97 


.98 




• j i 


101 


.26 


Q Q 
V O 


on 
. oil 


Language Arts 
SP71 


SD 

i 


s 


.46 


8 


.59 


9 


.14 


12 


.66 


8 


.87 


8 


.73 




g j 

i 


-0 


.22 


-1 


. 30 


0 


.04 


-0 


-51 


-0 


. 57 


0 


.02 


Attitude toward 


X 1 






103 


.72 






100 


.57 


101 


.40 


98 


.80 


Language Arts 
SP72 


SD 






8 


.59 






9 


.16 


8 


.37 


10 


.06 




S ! 






-0 


.62 






-0 


.23 


-0 


.40 


0 


.08 


SES 


X 


103 


.51 


90 


.12 


97 


.34 


94 


.94 


110 


.73 


96 


.63 




SD 


7 


.50 


5 


.99 


6 


.01 


6 


.83 


5 


.98 


6 


.90 




g 


-0 


.01 


0 


.11 


1 


.12 


0 


.88 


-1 


.28 


1 


.23 


Ethnic Group 2 


X 


0 


.75 


0 


.91 


0 


.63 


1 


.00 


1 


.00 


1 


.00 


(white=l; non- 




























white=0) 





























1 Index of skewness 



N 

N / N 



? *For binary coded variables the X is equal to tin. 

proportion of students coded with a "1." 
*Note: Blank entires indicate no data collected. 
> V-I-60 



. ( m ntimH ) . .. 

, where g = skewness index, 

x = deviation of a score 
from -X, where X is an 
EdExAG-group mean for 
variable X, and 
number of students. 
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TAISI.K V- 1-51 (con Lining) 



Vnr iab h 



^r^-.u: e s i 
Net; j I. i w j * On f 1 i er 



Sex ? X 
(feir 1=1 ; boy=0) 

lit i 1 izat ion of 
Ob j ec t ive.s 

Individualiza? ion 
in Deri. si (mi Making 

Teacher or Locally 
Developed Materials 

Indi vidua 1 i zat ion 
of Instruct iona 1 
Pare 

Scheduling Charac- 
terise LCS 

Use of Performance 
Agreement" s 

Classroom (I roup 
Organ i zat ion 

Teaching Unit 
Compos i t ion 

Completeness of 
Instruct ional 
Package 

Uti lizat ion of 
Student Evaluation 

hovel of Innovation 

Degree of Indiv- 
idua 1 i zat ion 

Number of School. 
Days per Year 

Number of Minutes 
per Day 



0.4 5 0.4 '3 



3.00 
1 .00 
1.50 
3.00 

3.00 
3.00 
3.00 
2.00 
2.50 

3.00 

i 

I 25.00 

I ? 
I 10.00 



60.00 



1 .00 



1.00 



L. 



op 



1 .00 
1 .00 
1 .00 
2.00 
1 . 50 

1 .67 

12.17 
4.67 

180.00 



0 . 50 



Ureal «'si 
Pos i t ive Out I iers 



.00 3.00 



.00 



50 



3.00 



3.00 



3.00 



3.00 



2. 50 



2. 50 



3.00 



2 5.50 ! : 



1 0 . 00 



0. 70 



1 .00 
1 . 50 
1 .00 

1 .00 
1 .00 
1 .00 
2.00 
1 .50 

2.33 

[3.33 
5.33 



180.00 !j 180.00 

i I 



4 5.00 60.00 



90 .00 



0. 52 



: .00 1 . 67 



1 .67 
2.50 



.00 



2.00 



.00 



..50 



2 .00 



2.6r 



0.53 



.00 



,00 



1 . 50 



2.00 , 1.00 



.00 



.00 



.00 



2. 50. 



. 50 



2.33 



18.00 1 3.83 
8.34 5.3 3 

180 .00 180.00 

60.00 90.00 
(com. inued) 



' For binary coded var 
coded with a 11 1 



iahles the X is equal to the proportion of students 

« v-r-6i 



9 

ERLC 
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TAI5U-: V-T-51 (continued) 



Variable 



Number of Teachers X 

Teacher 1 s Age X 

Teacher's Socio- ^X 
economic Back- 
ground 

Teaching Qual ii : i- X 
ca t i ons 



Greatest 
.Negative Outliers 



1.00 1.00 2.00 

24 .00 50.00 J5.00 

101 .71 91.11 105.40 

91. 70 108. 14 99.4 3 



Greatest ! 
Posit ive Out 1 iers 



1 .00 1 .00 1 .00 

50.00 50.00 40.00 

91 .1 1 87.22 9(5.82 

109.66 114.11 101.77 



I 



\'-r-62 
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A TAB LI- 'V-I-52 

Comparison o£ Key Analysis Vnri.nbl.es 
for Positive and Negative Outlier EdExAG Croups — 
Cohort 4, Spring 1973, Language Total Score Analysis 



Vnr inb los 






Or eat 
Nega r i ve. 


est 

Out 1 i i 


M"S 






Pes 


Crvn r 
i r i v e. 


-.'SI 

Our 1 


i ers 




Number of Students 




25 

» 


32 


13 


; i8 


28 




!3 


Post test Resid- 


X 


-19 


.76 


-21 


.18 


-24. 


48 


52 


.02 


39 


.33 


3.3. 


42 ' 


ual i zed for Pre- 
test and SES 


SO 


30 


.02 


32 


.52 


66. 


75 


31 


.26 


33 


.07 


* 43. 


22 • 




1 


-0 


.31 


-0 


. 24 


-0. 


85 


-0 


.27 


-0 


.28 


- 0 . 


20 : 


. .Pretest (National 
V Norm=46L) 


X 


447 


.29 


479 


.74 


460. 


00 


450 


.08 


492.87 


525 . 


20 


so 


29 


.20 


81 


.66 


49. 


47 


62 


. 17 


80 


.59 


60 . 


, 29 , 




1 

K 


-0 


.21 


0 


.39 


-0. 


58 


0 


.30 


0 


. 30 


0 . 


19 


Post test (Nat iona I 


X 


461 


.75 . 


49 1 


.02 


46 7. 


67 


534 


. 15 


5 59 


.07 


586 . 


,10 


Norm=497) 


SD 


36 


.13 


68 


.70 


72. 


9 2 


6 8 


.29 


6 3 


. 10 


55 . 


. 89 




( r 
£> 


-0 


. 11 


0 


.21- 


0, 


,32 


-0 


.01 


-0 


.01 


0 


.01 


t Attitude toward 


X 


. 1.04 


."69 


99 


.52 






9 5 


.85 


99 


.44 


104 . 


.07 


• Language Arts 
^P72 




7 


.13 


\8 


.88 






11 


.45 


. 6 


.63 


8 


.11 \ 




g 


. -0' 


* > 


0 


.00' ^ 






0 


.19 


0 


. 55 


-0 , 


.74 ! 


Attitude toward 


X 


i 93 


.80 




.60 . 






94 


.22 


105 


.07 


106 


.98 ; 


Language Arts 
• SP73 v 0 

n 


SO 


' 9 


. 13 


1 I 


.41 






10 


.17 


10 


.28 


9 


.25 : 


1 > 


8 


0 


.44 


0 


.23 






0 


.39 


-0 


.75 


-0 


.82 


sf.s 


X 


98 


. 15 


106 


.63 


97. 


,12 


92 


.49 


94 


.67 


110 


.57 


j t 


SD 


8 


.69 


8 


.29 


5 . 


.58 


5 


.26 


7 


.70 


6 


.04 


i 




-0 


. 1 1 


-0 


.62 




.02 


-0 


.68 


1 


.04 


-0 


.80 


j i 

| Ethnic Croup* 


X 


0 


.92 


0 


.97 


0 . 


.63 


0 


.89 


i 


.00 


1 


.00 



\ (white-1. ; non- 
•» white=0) 



1 



Index of skrwiu*:;:; 



A7 



i/iiere 



N 



? Fo r bin a r y e i ul o d van" a b 1 e :.; the X i s equal ' < > i.]u 

propor l. Ton of student:; coded with a ''i. u 
*Note: Blank entries indicate no data coll ec ted. 

V- 1-6 3 



( ('on t i nued) 

si: fwiio.'is i ndex , 

deviation of a score 
from X, where X is an 
EdExAG-group mean for 
variabje X, and 
number of* students. 
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TABI.K V-I-52 (continued)' 



0 



Variable 



Sex- 

(girl=l; boy=0) 



! Utilization of 
Objectives 

Ind ividualiza t ion 
in Decision Making 

I 

Teat: her or Locally 
Developed Materials 

Individualist ion 
: of Ins t rue t Lena L 
Pace 

I Sehedu 1 i ng Charac- 
: t e r L sties 

i Use- of Performance 
: Agreements 

. CLassroom Group 
j Organization 

i 

Teaching Unit 
Compos i t ion 

Completeness of 
Instruct ion a L 
Package 

Utilization of 
Student revaluation 

> 

Level of Innovation 

Degree of Individ- 
ualization 

Number of School 
Days per Year 

Number of Minutes | 
per Day | 

' For binary coded varial. 
coded with a "1." 



Greatest 
Negative Out L iers 



0.44 0.50 



3 . 00 



1.00 2.50 



2.67 



2.33 



0 . 50 



3.00 3.00 1.00 



.00 2.00 1.00 



1.00 2.00 2.00 



2.00 3.00 2.00 



1.00 2.00 1 .00 



I -00 3.00 1.00 



.00 2.00 



2.00 2.50 1 .00' 



50 



.00 



17.67 24.33 13.50 
6.6 7 10.33 5.00 



< : rt*ar<»si 
Pos itiyc Out 1 iers 

0.44 0.61 0.39 



1.67 3.00 3.00 



.67 1.00 l.(,7 



2.00 2.00 2.50 



2.00 3.00 3.00 



2.00 



.00 



2.50 



1.67 

19, 50 
7. 34 



.00 3.00 



2.00 3.00 s 3,00 



3.00 3 ♦.00, 

Ji, > 

2 .00 1} vf)0 



2.00 2.50 *n 2.50 



2.67 

23.1 7 
9.67 



2.67 

7 

in 

2 5.33 
10.34 



180.00 200.00 ^ 180.00 ! L82.00 180.00 178.00 

105.00 50.00 50.00 65.00 120.00 90.00 

. ...... . ■ (pont inueel ) 

les the X is equal to the proportion of students 

V-I--64 
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TAlilA V-I-52 (continued) 



Variable 


1 




Cren t.<*st 


i rs _ 


i 

! 


1 


( I re a i .»s \ 
'os-i r i ve Out 1 i 


t » r s 




Teacher /S tuden t X 
Contact Ratio* 1 


► 


• .) i 




i 


O "7 

; 


1 3 


.33 


A. .13 


3 


9 A 


Number of Teachers X 


: i 

i 


.OA 


1 .03 


1 


.00 ' 


2 


.00 


2 . 00 


9 


96 


Teacher's Age X 


j 39 


80 


AO. 00 


30 


J 

00 ! 

i 


AO 


.00 


55.00' 


31 


16 


Teacher's Socio- X 
economi c Background 


82 


96 


9 3.95 


. 96 


90 \ 


9 A 


.69 


82.68 


105 


28 


Teaching Qua 1 i f i- x 


105 


1A 


106 . ^ 7 


97 


95 : 


86 


63 


106. 31 


91 


55 



ca t ions 



. ; . ; ; " ; * t - - - .... 

Relative measure of Leacher/sLudont contact equal to the percent of teacher 
time per Individual sLudent 



4 17 
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TABLE V-I-53 

Comparison of Key Analysis Variables 
for Positive and Negative Outlier EdExAG Groups — 
Cohort 6, Sprang 1972, Language Total Score Analysis 































Variable 




\ (Greatest 
Negative Outliers 


Crear«*s.i 
Pos i t ivp Our 1 i *: 






Number of Students 




\ 

103\ 

V 


57 


161 


84 


102 




47 


Posttest Resid- 


X 


-2 


.75 


-9 


.00 


-10 


.79 


14 


.31 


6. 


90 


5 


•75 


ualized for Pre- 
test and SES 


SD 


45 


.89 


40 


.96 


42 


.16 


44 


.3L> 


55. 


99 


36 


.28 




s 1 


-0 


.24 


0 


.It 


-0 


.16 


0 


.28 


0. 


07 ' 


-0 


.12 


Pre tes t (Na t ional 


X 


495 


.45 


501 


.49 


541 


.46 


517 


.18 


534. 


65 


517 


.86 


Norm=497) 


SI; 


64 


.72 


72 


.05 


. 71 


.14 


64 


.94 


66. 


12 


75 


.54 




g 


0 


.68 


0 


.40 


0 


14 


- 


.13 


-0. 


06 


0 


.13 


Post tost (Inter- 


X 


501 


.92 


503 


. 38 


543 


62 


546 


.06 


55^. 


31 


534 


.11 


polated National 
Norm=5 31.5) 


SD 


73 


.29 


76 


.04 


72 


.24 


• 80 


.45 


72. 


80 


'72 


.37 




8 


u 


. <4 O 


U 


. / / 


0 


.16 


U 


. J :) 


0. 


20 


0 


.16 


Attitude toward 


X 


105 


.37 


98 


.57 


100 


45 


103 


.65 


104. 


09 


100 


.75 


Language Arts 
SP71 


Si; 


10 


.49 


10 


.18 


9 


20 


r 'in 


.16 


10. 


09 


« 


« 74 




g 


-0 


.73 


0 


.15 


-0 


.09 


-0 


.36 


-0 . 


60 


-0 


.09 


Attitude toward 


X 


99 


38 


* 




98 


15 


105 


.81 


106.67 






Language Arts 
SP72 


SD j 

i 


11 


.02 






9 


50 


8 


.73 


8. 


42 










0 


.06 






0 


08 


-0 


.63 


-0. 


53 






SES 


X 


■ 93 


99 


98 


.03 


108.. 82 


107 


.45- 


107. 


26 


100 


.24 




SD 1 


8 


.53 


7 


.50 


6 


84 


8 


.51 


7 . 


25 


9 


.24 




g 


0 


47 


0 


.49 


-I 


1.2 ! 


-0 


.91 


-0. 


78 


0 


• 29 




- , i 












i 








(font inued ) 



rp.de:-: of .sk fwr.ess Y.:< { 

o . JL l 

>.x__ //>.?:' 

N / " n" 



*Note: Blank entries indicate no data collected. 



where g = skc>v:nes» inctox, 

x = deviation of a score 
from X, where X is an 
EdExAG-group mean for 
^variable X, and 
N = number of students. 



V-I-66 



418 



r 



v ci r i ci d l e 


tir».';iti.»st 
Negative Out 1 iers 


G 

Posi r 


i v Out 


iers' 




Ethnic Group- X 
vwnice-i, non- 
, white=0) 


0 


.39 


0.69 


0.98 


0.86 


') . c ^ ? 


0 


.79 


o 

Spy y 

OLA ^ 

(girl=l; boy=0) 


n 
u 


. 30 


n / o 


0 . ^ 0 


0.45 


0..60 


0 


.51 


Utilization of 
Obj ecti.ves 

I 


J. 


7 


1 . 00 


3.00 


3.00' 


3.00 


1 


.00 


i 

j Individualization 
j in Decision Making 

j 


1 
J. 


nn 


1 . JJ 


1 .00 


2.00 


1.00 


1 


.00 


j leacuer or LocaiJy 
j Developed Materials 


1 


00 


i ^n 


/ . jU 


2.00 


2.00 

t 


2 


.00 


liiuiviuudiizciL ion or 
j Instructional Pace 


1 

J. 


nn 


Z . UU 


1 . 00 


2.00 


3.00 


2 


.00 


oLtieauiing Lnarac— 
terist ics 


1 
J. 


nn 

. uu 


i . UU 


3 . 00 


2.00 


2.00 


1 


.00 


Use of Performance 
Agreements 


1 


00 


1.00 


•2-. 00 


1.00 


1.00 


2 


00 


Classroom Group 
Organization 


1. 


00 


2.00 


3.00 


2.00 


2.00 


2 


00 


Teaching Unit 
Composi ti on 


1. 


00 


2.00 


1 .00 


2.00 


2.00 


2. 


00 


Completeness of 
Instructional 0 
Package 


1. 


50 


1.50 


V . 
2.0© 


2 . 50 


2 . 50 


1. 


50 


Utilization of 
Student Evaluation 


1. 


67 


',1.67 


3.00 


3.00 


3.00 


1. 


t 


i 

Level of Innovation 


11. 


83 


15.00 


22.50 


21.50 


21.50 


16. 


i 

17 i 


i Degree of Individual! 
zation j 


4. 


67 


6.00 


8.00 

. 


8.00 


8.00 6.67 | 
(continued ) 


For binary co^ed variables 
coded with a "1." 


the 


X is equal 


to the 


proportion 


of students 
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TABLK V-r-5 3 (continued) 



. . -Lible 

Number of School 
; Days per Year 

| Number of Minutes 
i per Day 

Number of Teachers. X 



I 'I eac her ' s Age 

| 

| Teac her ' s Soc i o- 

| economic Back- 

| ground 

I 

■ 'l each i ny\ Oua 1 i I i ■ 

! ca ( i ons 



X 
X 



(Iron test 
Negnt ive Out 1 i its 



180.00 L80.00 180.00 



60.00 60 .00 



] . 19 
36.89 
93.9 3 

1*02. 18 



1 .00 
30 .00 
98.65 

91.53 



30.00 

4 .00 
29.50 
11 1 .12 

85.27 



Greatest 
Pos i L i v e Out 1 iers 



200.00 200.00 



60.00 

2.7.1 
32.15 
9 7.40 

92.83 



60 . 00 

1 .96 
30 . 1 0 
112.04 



180.00 



60 .00 



1 

30 
17 



.00 



00 ! 



86 



92.05 103.06 
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TABLE V-l-54 



Comparison of Key Analysis Variables 
for Positive and Negative Outlier EciExAG Groups — 
Coho/t 6, Spring 1973, Language Total Score Analysis 



Variable 



Number of Students 



Posttest Resid- 
ua li zed for Pre- 
test and SES 



Pretest (Inter- 
polated National 
Norm=531. 5) 



Post test (National 
| Norm=557) 



, At tit ude toward 
Language Arts 
SP72 *• 



Attitude toward 
Language Arts 
SP73 



SES 



fndi 



skfwni 



X 

SD 

ol 
r> 

X 

SD 

g 
X 

SD 

g 

X 

SD 

g 

X 

SD 
X 

SD 
g 



Great es'f 
Nega tive Out 1 i ers 



42 

-13.22 
39. 16 
0.40 

563.62 
94.57 
0.61. 

556. 37 
85.85 
0.41 

1.0 5.70 
8.01 
-0.7 5 

L01. 1 J 
7.71 
-0.5 3 

104.6 2 
7.87 
-0.71 



45 

-14.15 
42.06 
-0.62 

579.10 
70.21 

0. 74 

580.20 
82.02 

1 . ()fe 

106.67 
9.24 
-0.7 3 

105.63 
7.60 
-0.14 

L07.24 
6.69 
-0.4 3 



-15 
34 
-0 

577. 
68. 
0. 

577. 
65. 
0. 

105. 
9 . 
-0 



46 

.58 
.75 
.04 

41 
69 
14 

23 
74 
50 

.87 
. L6 
.9 3 



102.42 
8.99 
-0. 39 

107. 15 
7.94 
=0.81 



Greatest 
Positive Outl iers 



165 

13.77" 

44.13 

-0.0J 

554.64 
73.48 
0.45 

586.97 
79.85 
0. 39 

98. 15 
9.08 
0.00 

97.44 
9.46 
0.09 

10 8-. 80 
6.93 
-1.03 



375 

7,26 
53. 1 1 
-J . 1.9 

539.93 
75.90 
0.62 

56*2.6 3 
85.59 
0.08 

99 .24 
9.80 
-0.15 

100.58 
9.82 
-0.18 

96.22 
6.91 
-.76 



27 

2.77 
39 .42 
-0.22 

530.87 
52.48 
0.33 

551.50 
65.46 
0.42 



99 .19 
8.26 
0.63 



(con t i n ued) 



win* re g 
x 



*Not:e: Blank entries indicate no data 
<:o 1 LerU'd . 



N = 



deviation of a score 
from X, where X is an 
EdExAG- group mean for 
variable X, and 
number of students. 



ERLC 



V-l-6 l J 



4^ i 



TABLE V-I-54 (continued) 



V ar lable 


" Greatest 
Negative Outliers 


Greatest 
"'Positive Outliers 


Ethnic Group 2 / X 
. (white=i; non- 7 
white^O) 


0 


.83 


0.91 


0 


.93 


0.98 


0.97 


0.85 


! Sex" x 
j (girl=l; boy^O) 


n 
u 


• D 1 


U . bU 


0 


.57 


0.51 


0.57 


0.52 


Utilization of 
Ob j ect ives 


J 


nn 
. uu 


t nn 


3 


.00 


3.00 


1.67 


1.00 


Individualization 
in Decision Making 


9 
Z 


nn 
. uu 


o nn 
z . UU 


1 


. 33 


1 .00 


1.00 


1 .00 


7>?rher or Locally 
loped Materials 


9 

L. 


nn 

• uu 


9 nn 
z . UU 


1 


en 

. jU 


2 . 50 


2 .00 


2.00 


Individualization of 
Instructional Pace 




no 


9 nn 
z ,,uu 


9 
Z 


nn 
. UU 


2 . 00 


1 .00 


1.00 


Scheduling Character- 
istics 


Z 


nn 
UU 


Z . UU 


2 


.00 


3.00 


1.00 


1.00 


Use of Performance 
Agreement s 


T 

J . 


nn 
uu 


l nn 
1 . UU 


o 

z 


nn 

00 


2 .00 


1 .00 


2.00 


Classroom Group 
Organizat ion 


9 


nn 
UU 


z . OU 


2 . 


00 


2 .00 


2 ,00 


3.00 


Teaching Unit 
Composition 


2. 


50 


2.50 


2. 


50 


1.00 


1.00 


1.50 


Compf?teness of- 
Instructional Pace 


2 . 


50 


2.00 


1. 


50 


2.00 


1.00 


1.00 


Utilization of 1 
Student Evaluation 


2 . 


33 


3.00 


3. 


00 


3.00 


1.33 


1.00 


Level of Innovation 


24. 


33 


21.50 


20. 


83 


. ^\ 
21.50 


13.00 


14.50 


Degree of Individ- 
ualization j 

i 


10. 


33 


8.00 


8. 


33 


8.00 


a 4.33 

/ ^ ' 

(cont 


^.00 

i i.ued) 



For binary coded variables the X is equal to the proportion of student 
coded with a "1 . " 
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TABLE V-I-54 (continued) 



Variable 
\ ■ 




Greatest 
Negative Out 


1 iers 




Greatest- 
Positive Outliers 


Number of^School 
Days per Year 




200 


.00 


200 


.00 


200 


.00 


178 


.00 


182.00 


180.00 


j Number of Minutes 
! per Day 




50 


.00 


" 50 


.00 


50 


.00 


30 


.00 


50.00 


50.00 


Teacher/Student 
Contact Ratio 3 




3 


33 


2 


.70 


3 


33 


2 


.86 


3.35 


3.85 


Number of Teachers 


X 


1 


.02 


1 


.00 


1 


02 


6 


00 


1.00 


l.do, 


Teacher 1 s Age 


X 


40 


.00 


30 


00 


24 


17 


34 


00 


39.36 


30.00 


Teacher's Socio- 
economic Background 


X 


93 


95 


.117 


84 


107 


04 


110 


15 


102.47 


98.24 


Teaching Qualifi- 
cations 


X 


10 6 


. 5 5 


98 


57 


92 


46 


91 

1 


.50 


103.20 


10?.44 



Relative measure of teacher /student contact equal to the percent of teacher 
time per individual student 
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TAB LI- V- l-Vi 



Comparison of Key Analysis Variables for 
Students Exhibiting Unusual Longitudinal Growth Patterns 

In Two Consceur i ve School. Years— Cohort 1. , Lan^ua^o Total Seore Analysis 



Variable 



Number of Students 



! SRS 



SI) 



(Ions i s ten t 
Underachievers 



V) 

101 . 8 '4 
10.28 
0.0 3 



n 



Cons i s t en t 
Overaeli i evers 



58 

102. M 
9. 55 
-0. 20 



> O V. ' 

l .■ i r I - 1 : ho 



0. J8 



;.: hn i i- or.iu; 
1 vh i l ; :i. 
■■:h i'l. * 0 1 



1' re 1 es t ( i t ' I '."urn 
MA-S") for Si 1 7 J ; 

1 y.o---- u: s t 

Si"!" i ) 

i'o^: I .'st 1 1 i Norr; 

for S : ' J ; 
"-' >. c 2 for Si 1 7 > ) 



so ! 



SD 



; \ _ 

j PosLtest Ho siii- X 

j ualined for Protest 

! and SKS 



! of I it nd' 1 t ovnrd 

1 i..' n.'i.a ' i 1 Ar t a r 

1 ... . - ., 

I I 1 ::u- m 1 .Ore t es t 



Ana 1 vs i s Yi ar 

s 1 * 71. ' spy v 



42.9-4 

l > . hh 
- u . j h 

7 i 

'i . . > 1 

n . 1 i 



280.71 1 

i 

0. M ! 

WIS. V. 

?h. .id 
-n.07 ! 

- 1 O 



-I 



O.S I 



Ana I vs i s Yea r 



SP72_ 
1 . i 1 
1 1 . 1 h 
- I .Si 

"liVi . 07 
17.92 
--O./4/4 



SP 7 J 
405/07 

1 7 . 9 2 

"iOO . J2 
'*(). 59 
-0. ! 7 

1.71 

2 - . I S 
it. f ) J 



1 r.i.:; 
*.' rou 



I ' » r e : nary roa-d var 1 ii 
j) ropoj" ! i ■ T. . 1 ! . * 1 i;dt - a ; : . 

a • ■ : • n ; r i r ■; in 



an 1 ''i v.; ' i oh ] , 



X , (Old 

m 1 ; ! ; 1 r' i 1 ! 



1 I 



n. da l a 



9 

ERLC 



4 2 i 



s 



IAKLK V-f-55 front inued> 



Variable 



Attitude toward 
Language at Time of 
Post test 



U t L 1 ization of 
Oh jec t ives 

! Individual 1 i zntion 
! i n Dc c: i s i o n Making 

i 

j Teacher or Loral. ly 
Dove loped Ma ter ia I s 

Individualization 
of Instructional 
Pace 

i Sehodu 1 ing 

I "Characteristics 

i 

: Use of Performance 
j Agreements 

i Classroom (iroun 
i Organization 
I 

Teaching Unit 
: Composition 

Comp 1 e t e n c s s o f 
Instruct ionn 1 
Package 

U t i 1 i za t ton o f 
.Student Kvalua- 
L ion 



X 

SD 
X 

SD 
X 

SI) 
X 

sn 
x 

SD 



SD 
X 

SD 
X 

SD 

SD 
X 

SD 
SD 



Cons is tent 
Underach ievers 
SP72 A P JL1 
* 100.57 
10.01 



2. 79 
0.58 

1 .45 
,0.5 7 

1 .oh 
0.43 

2.35 
0 . h 7 

1 .60 

1 . 5 5 
0.60 

I . 9 h 
0 . ft I 

2.05 

2. 38 
0. 58 

2. 50 
0. 60 



-0.3 5 

2.89 
0.3 5 

1 .53 
0.55 

] . 70 
0. 38 

2.36 
0,52 

1 .84 
0.7 3 

I .85 
0.82 

2.35 
0.48 

2.26 
0. 59 

2.27 
0. 36 

2.60 
0.4 1 



I ; 

; i 



i ! 



Consistent 
Overach ievers 
SP72 _ _ SP73 

99.58 

10. 17 

0.02 



2 . 6.9 
0.72 

1.4} 
0.3 5 

1 . 6 1 
0. 56 

2. 38 

0 . 5 5 

1 . 72 
0.71 

1 . 6 .', 
0.61 

2. 38 
0.64 

2.02 
0. 66 

2.01 
0.71 

. 2 . 'j 9 
0. r )7 



2.48 

) 

0.77 -j 

1 .40 
0.49 

1.72" | 

i 

0.40 

t 

2.19 : 
0 . 39 ! 

1.53 ' 
0.56 j 

1.81 ! 
0.84 

2.33 
0.47 

2.09 
0.71 

1.93 
0. r ^9 



Level of 
Fnnova t i on 



•N'ote: lilank entries 



A 

SD 



20. 30 
3. 78 



, 66 

, 60 



indicate no data collected... 

V- 1-71 



20. 3 7 



19.92 
3. 56 



( con t i nued ) 



ERLC 
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TABLE V-I-55 (continued) 



Variable 



Consistent 
Underachievers 
SP72 SP73 



Consis tent 
Overachievers 
SP72 SP73 



egree of Indiv- 
idualization 





Number~o~F>Schoo 1 
Days per Yea^ 

Number of Minutes 
per Day 

Teacher/Student 
Contact Ratio 3 

Number of Teachers 



Teacher's Age 



Teacher's Socio- 
economic Back- 
ground 

Teaching 
Qualifications 



SD 

\r 
»v 

SD 

X 
SD 

X 
SD 

X 
SD 

SD 
X 

SD 



7.85 

184.44 
9.67 

83. 32 
24.18 



2.27 
1.93 

31.42 

5.9: 

102.13 
7.ol 

98.51 
7.33 



8.34 

184.44 
9.67 

97.32 
38.73 

4.22 
1.53 

1.11 
0.31 

32.72 
8.18 

104.23 
12.04 

100.23 
6.49 



7.94 

184.62 
8.72 

100.26 
21 .4b 



1.98 
1.47 

34.31 
9.37 

100.83 
7.70 

99.20 
6.42 



7.84 

184.62 
8\72 

90.09 
26.63 

4.15 

f 

1.44 

1.03 
0.26 

36.91 
11.60 

99.95 
10.33 

102.71 
6.71 



^Relative measure of t».a?:hfcr/ci 
teacher time per ir.uividi" 

*Note: Blank entries indie? nc data collected. 



■nt contact equal to the percent of 
nt. 
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TABLE V-I-56 



Comparison of Key Analysis Variables for 
Students Exhibiting Unusual Longitudinal Growth Patterns 
In Two Consecutive School Years—Cohort 4, Language Total -Score Analysis 



Variables 



Number' of Students 
SES 



X 
SD 
g 1 
X 



Sex* 

. (girl=i; boy=0) 

Ethnic Groups 5 
(while-l; non- 
white-0) 



; Pretest (Nat '1 Norm X 
1=422 for SP72; 
I Nat 1 1 Norm=46J for ■ SD 
|SP73) g 



Post test (Nat 1 1 Norm X 
=461 for SP72; 
=497 for SP73) 

g 



SD 



PosLtest Resld- 
ualizec fir p 
and SES 



;r Pretest 



\ Atr.ir 'Sir tow;- 
' Laugua^o <u ts 
i i ir c Pre* 



X 
SD 

4 

SD 

8 



1 Index of skewness 



Consistent 
Underachiever's 



79 

100.37 
10. AO 
0.11 

0.33 

0.86 
Analysis Year 



Consistent 
Overachievers• 



SP72 



SP73 



419.97 
63.07 
0.53 

416.44 
54.84 
0.46 

-44.54 
21.19 
-1.55 

96.77 
10. 78^ s 
0.02 



416.44 
54.82 
0.46 

414.74 
52.38 
0. 31 

-40.35 
20.88 
-1.73 

98.57 
11.00 
-0.10 



101 

99.66 
9.26 
0.13 

■ 0.53 

0.91 
Analysis Year 



SP72 



SP73 



462.35 
46.80 
.-0.12 

540. 63 
48.93 
0. 10 

41. 52 
17.57 
1.11 

102. 13 
9.23 
-0.80 



540.63 
48.93 
-0. 10 

608.55 
47.51 
-0. 18 

45.98 
19.35 
0. 71 

101.14 
8.62 
-0.30 



(continued) J 



N 



, where? £ = skewness index*, 



N 



? For binary codf\d variables the X is equal t< 
proportion of ".students coded with a "1." 



the 



x = deviation of a score 

from X, where X is that 
group's mean on variable 
X, and 

N = number of students . 
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TABLE V-P56 ' (cofttinued) 



Variable ^ 






Cons 


is tent , 






Consistent 






u Undera 


chievers 






Overachievers 








SP72 


SP73 


SP72 


SP73 


xVttitude toward 


X 


98 


.57 


100 


.51 


101 


. 14 


102 


. 80 


Language Arts at 


SD 


11 














Time of Posttest 


. 00 


ii 


An 


Q 

o 


£ 9 
• O Z 


r 

b 


.29 




g 


-6 


10 


— n 
u 


. ZZ 


-u 


.30 v 


-0 


.19 


Utilization of 


X 


2 


.73 


2 


.69 


2 


.27 


2 


. 36 ' 


Objectives 


SD 
















0 


.63 


0 


.56 


0 


.90 


6 


. 75 


Individualization 


X 


1 


.46 


1 


.49 


1 


. 28 


i 


. 3 . 


: in Decision Making 


SD 


o 
















43 
• *t -j 


u 


. 41 


U 


. jo 


0 


40 


Teacher or Locally 


X 




. 9.1 


2 


08 


1 


. 78 


1 


93 


Developed Materials 


SD 


















0 


,53 


0 


61 


0 


.55 


0. 


54 


Ind ividthi liz^r inn 


x 

> 


2 


.10 


\ 2 


37 


1 


.87 


2 


13 


; of Instructional 


SD 


0 














jPace 


.59 


0. 


66 


0 


.65 


o. 


67 


Scheduling 








i 


o± 


1 


4b 


1 . 


61 


Characteristics 


SD 


















0. 


59 


0. 


58 


0 


55 


0. 


60 


Use of Performance 


X 


1. 


43 


- 1. 


71 


1 


41 


1. 


73 


Agreements 


SD 


0. 


57 












* 0. 


84 


o 


58 


n 

\J a 


/ O 


Classroom Group 


X 


■ 1. 


85 




11 


1. 


74 




01 


Organization 


SD 


0. 


64 












0. 


53 


0 


73 


n 


?0 


Teaching Unit 


X 


1. 


94 ' 


2. 


11 


1. 


71 1 


I. 


72 


Composition 


SD 


0. 


69 














0. 


61 


0. 


70 


0. 


V,5 


VjKJ\\\\j ±>i L que S S Ot 


Y 

A. 


2 . 


10 


2. 


18 


1. 


89 




05 


Instructional 


SD 


0. 














Package 


55 


0. 


47 


0. 


63 \ , 


o t 


48 i 


Utilization of 


X 


2. 


62 


2. 


60 > 


2. 


35 






Student Evalua- 


SD 


0. 














tion ■ 


57 


0. 


53 


0. 


65 


0. 


47 


Level of 


A 


19. 


b7 


21. 


15 


17. 


77 


j 


4 6 


Innovat ion. 






















SD 

i 


3. 


54 


3, 


10 | 


4. 


40 


3. 


75 
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TABLE V-I-56 (continued) 

\ 



1 

Variable 


Consistent 
Underachievers 
SP72 SP73 ; 


- 

Consistent 
Overachievers 
SPJ2 SP73 


Degree of Indiv- 


X 


7 


.61 


.8 


."17 


6 


.91 


7.77 


idualization 














; Number of School 


X 


182 




1 09 


7 I 


? ' 1 Q 7 


i 

. UZ 


1Q1 Q Q 

ioi . oo 


jDays per Year 


SD 




si 










7 


7 


. jU 


O 


. /U 


b . o4 


Number of Minutes 


X 


98 


.54 


75 


.14 


97 


. 38 ' 


84.03* 


Dr*r Dav 


SD 


21 


.89 










26 


23 


24 


.96 


26.94 


Teacher/Student 


X 


* 




3 


24 






y. 4 3 


Contact Ratio 3 


SD 




















0 


73 


• 




0.60 


iMurnDtir or icacners 


V 

• A 


1 


. 57 


1 


38 


, 1 


.95 


,1.82 




SD 


1 


31 


0 


70 


1 


93 


2.13 


Teacher's Age 


X 


34 


.49 


35 


89 


38 


.47 


37.81 


- 


SD 


8 


.89 


9. 


,84 

1 


11 


34 


9.90 


Teacher's Socio- 


- X 


100 


.54 


100. 


03 


99 


05 


98.16 '■ 


economic Back- 


SD 




98 












ground » 


9 


9. 


14 


10 


"86 


10.45 


Teaching 


X 


101. 


97 


100. 


98 


103. 


14 


101.01 


Qualifications 


SD 
f 


8. 


22 




82 








7. 


7 1 


51 


6.48 


, j «__, 



Relative measure- of ^teacher/student contact- equal to the percent of 
teacher fc-irme per individual student 1 
*Note: Blank entries indicate no data collected. 
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TABLE V-I-57 

Comparison of Key Analysis Variables for 
Students Exhibiting Unusual Longitudinal Growth Patterns 
In Two Consecutive School Year's — Cohort 6, Language Total Score Analysis 



1 n d e x of sk ou n e s s 



Variables 




Consistent 






Consistent 




Under achievers 




Over achievers 




MiiTnKf^T n f Q t~ 1 1 A on t~ c 

HULL? C: L UL jLUUcllLb 








49, 












69 






SES 


X 
SD 






100. 
9 
0. 


85 
19 

20 










100 
9 

0 


.24 

.92 
.30 






X 






0. 


45 










0 


.71 




(girl=i; boy=0) 


























P t" Vin t i * ( t t n 1 1 n ■ 


V 
iV 






0. 


84 










0 


.90 




(white=l; non- 


























vhite=0) 




Analysis Year 




Aualys 


is Year 








SP72 






SP73 


SP72 




SP73 


PrptPSt" f Nnt 1 ] Nnrm 

I l_ C L O l_ -L LiU J. Ill 


Y 


533 


.85 






496 


83 


544 


.54 




601 


.24 


= 497 for SP72; In- 
terpolated Nat'l 


lD u 


64 


.10 






56 


05 


68 


.55 




69 


.88 


Norm=531.5 for SP73.) 


8 


0 


.39 






0 


66 


0 


.18 




0 


.16 


Post test ( Interpo- 


X 


496 


.83 






464. 


98 


601 


.24 




659 ..89 


lated Nat'l Norm 
=531.5 for SP72; 


SD 


56 


.05 






60. 


88 


69 


.88 




75 


.59 


Nat'l Norm=557 


g 


0 


66 






0. 


27 


0 


.15 




0 


.39 


for SP73) 


























Posttest Resid- 


X 


-46 


.29 






-53. 


70 


48 


.80 




48 


.49 


ua lized for Pretest 
and SES 


SD 


22 


61 






31. 


96 


20 


.87 




24 


.46 




g 


-1 


.66 






-1. 


84 


0 


.91 




1 


.35 


Attitude toward 


X 


101 


44 






98. 


3*5 


101 


.99 




102 


.08 


Language Arts at 
Time of Prestest 


SD 




21 






10. 


55 


10 


.43 




8 


.97 ^ 




g 


-0 


10 






0. 


10 


-0 


.25 




-0 
(cont 


.32 

inued) 



" N 



zzzr — , where g = skewness Index, 
M 



-For binary coded variables the X is equal to the 
proportion of students coded with a f, l. n 



x = deviat ion of a score 

from X, where X is that 
'group's mean on variable 
X, and 
N = number of students. 
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TABLE V-I-57 (continued) 



Variable 


Consistent 
Underaehievers 
SP72 SP73 


Consistent 
Overachievers 
SP72 . SP73 


Attitude toward 


X 


98.35 


i nn 




1 H9 


no 
. uo 


— 

\ 104 


.38 


Language Arts at 


SD 


10.55 










Timp nf Pnc^^oc^ 


9 


.17 


8 


.97 


8 


. 35 




Q 


o i n 


u 


9 1 
. Z J 


- U 


9 9 
. JZ 


-0 


.48 


Utilization of 


X 


2.31 , 


2 


.44 


2 


.43 


2 


.39 


Objectives 


SD 


0.83 










0 


.59 


0 


.70 


0 


.67 


Individualization 


X 


1,24 


1 


.22 


1 


.27 


1 


. r.2 


in Decision Making 


SD 


0.2 5 














n 

\j 




u 


9 9 


U 


28 


Tpachpr -or I nr'r 1\; 

league l \*j L Li U l_ d _l _L y 


A 


I . JO 


2 


.57 


2 


. 39 


2 


41 


Developed Materials 


SD 


0.65 










0 


.47 


0 




0 


51 


Tnrii \t i H 1 1 .q 1 *i v n t~ ^ n 


Y 
A 


/.Do 


1 


. 94 


• 


. L ) } 


1 


.86 


of Instructional 


SD 














Pace 


0. 74 


0 


.65 


0 


.80 


0 


77 


Scheduling 


X 


1. 76 


1 


.57 


L 


.77 


1. 


61 


Characteristics 


3D 
















0.85 


0 


64 


0 


.80 


0 


62 


Use of Performanc- 


X 


1 . 51 




7 l 


1 


9R 
JO 


i. 


46 


Agreements 


SD 


0.64 












o 


81 


n 




0 


65 


Classroom Group 


X 


2.00 


1. 


92 


2 


01 


1. 


93 


0 r 2 an izatinn 


SD 


0.40 














0. 


27 


0 


»G 


0.31 


Teaching Unit 


X 


1.70 


0. 


62 


1. 


62 


1. 


64 


Composi tion 


SD 


















n 


A 9 
0 Z 


U 


£ 9 
O J 


•0. 


67 


Completeness of 


X 


1.95 


1. 


99 


1. 


91 


1. 


80 


Instruct ional 


SD 


0.59 














Package 


0 


63 


0. 


67 


0. 


69 


Utilization of 


X 


2.32 


2. 


14 


2. 


32 


2. 


26 


Student Evalua- 


SD 


0.71 












tion 


0. 


86 


0, 


77 


0. 


82 


Level of 


X 


19.20 


19. 


14 


19. 


02 


18. 


57 


Innovat ion 




















SD 


4.73 


4 . 


27 


4. 


95 


4. 


76 
















(cont inued) 
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TABLE V-I-57 (continued) 



Variable 


Consistent 
Under achievers 
SP72 ■ SP73 


Consistent 
Overachievers 
SP72 SP73 


Degree of 


Indiv- 


X 


7 


.13 


7 


.01 


7 


.29 


6.80 


idualizat 


ion 
















Number of 


School 


X 


181 


.22 


181 


.39 


182 


.03 


182.49 


Days per 


Year 


SD 




79 












4 


4 


.92 


6 


.04 


6.03 


Number of 


Minutes 


X 


56 


.33 


50 


82 


56 


.23 


51.30 


per Day 




SD 
















10 


24 


7 


52 


10 


.37 


7.40 


Teacher / Student 


X 


* 




3. 


46 






3.29 


Con tac t Rat id 


SD 
























0, 


63 






0.50 


Number of 


Teachers 


X 


1. 


Q Q 


3 . 


10 


2 


.22 


2.33 






SD 


1. 


66 ' 


o 

C m 


41 


2 


.05 


2.32 


Teacher 1 s 


Age 


X 


33. 


71 


37. 


67 


33 


.01 


38.50 






SD 


9. 


49 


9. 


00 


10 


.90 


10.01 


Teacher 1 s 


Socio- 


X 


105. 


52 


102. 


32 ' 


105 


.96 


99.63 


economic 


3ack- 


















ground 




SD 


8. 


90 


8. 


59 


7 


. 72 


9.86 


Teaching 




X 


96. 


42 


99. 


17 


96 


.14 


101.20 


Quali f i cat ions 


SD 


8. 


















30 


6. 


46 


7 


.39 


5.66 



'Relative measure of teacher/student contact equal to the percent of 
teacher time per individual stuc/ent 
*Note: Blank entries indicate no data collected. 
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APPKN'IUX V-.i 

Post: cos t /Norm and Pretest /Norm Compar isons 
Ar i thmot i r Total Si' ore Analvso.s 



4 3Y 



FRir 



TABLK V-.J-l 



PostLesi 'Morni and Pre* tes t /Norm Comparisons - - 
■? ic Total Score Analyses 



ohort 1 Cohort- 4 Cohort h 

s . w .7.2 : _ _SP 7_3_ __ SP 7 2 S P 7 3 S P 7 2 S P 7 i 

o » t t i s l Moan/ 

hit: P i ) !V renre ; 17 ' 02 19 ' 79 *-6*> 4.84 .80 -7.19 



at in 

r.a^l Mean/ 
orm 0 i f t'e ren co • 

rv !H f f o roniv 

at io 



•44 .47 .12 .08 .01 -. 10 

* I'ift. 15 4.69 9.44 11.46 7.67 

* ■. .43 ,12 .17 .20 .11 



r 



Norm based on 50th percentile for spring testing. 



X - Norm 

pos t Los t 

' SP 



a - x o rm 

pre tes t 



SD 



p re test 



CTMM was used. 
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APPENDIX V-K 

ui in Possible I'o.sttivm- and Pivti'st Mi-an Shi 
Attributable I.j 'IVs t Topouf F.ffcris - 
Ar i l\):uri i Tola 1 Smw Ana i vsps 



4.3'i 



TABI.K V-K - ] 



Maximum' Possib le Pos t u-s t' and Protest Mean Shifts \ 
Attributable to Test Topout Kf foots - \ 
Arithmetic Tula! Srwri- Analyses \ 



(\ri.-i Analvs is Sample j ! Analys is Sample 

i.si "y" ' ' \ and Ti>poiits- Mean D i f fvrcncc 

!. ' ..; i,OSttesl ' ^ U '*\ ' ^ost: pr,t,s,'.. N J'° SU " st ,,r " U ' st 

Cohort 1 , 

SP7V w7.79 319.15 741 379.74 322.05' 7 53 ' 1.95 ' 2.90 

Cohor t 4 , 

SP/J 44n.nn 4u4.tV-J 194 3 453.50 407.87 juil) h . 84 J. 1 8 

Coin ■■ ' 4 , 

SP7j ^80.84 449.4/4 1964 484.85 54 5.27 20 12 5.99 4.83 

Cob orf 6 , w 

SP72 •)!(). H) 487.46 1443 318.84 49 5.23 149 7 8.34 ■ 3.79 

Cohort n r 

. SP 7 ] >3/.81 3 17.17 1303 54 3.43 52b. 26 1567 7.64 9.09 



'Cohort 1, SP72 is not inrluiloil hocauso the. p re res t was the CTMM raid the 
post test , tire CTHS. 

Moans shown here were comp; 1 Led. assum i n« Chat students who topped out 
obtained the maximum pretest and posttest scores. 

'Absolute value of the difference. 

"N'o topout s in this sample. - 
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APPENDIX V-I, 

Commonality Analysis of SF.S — 
Arithmetic Total ScorV Analyses 
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TAHU-: V-L-l 



Commonal it y Analysis of SMS — 
Cohort L, Spring 1972, Arithmetic Total Score Analysis 

P rot ti«t " KdKxA'ii " Toachfr 

- . . _ ..(.P.). i^^y.J'i^V.^JO. Variah 1 .\s ( 

.02706 .33150 .00130 

C(P,D) .00901 .00901 

cuvn .0000/4 .oooo-'* 

C'0),T) .05004 .05004 

C(P,I)/n -.00732 -.00732 - .00732 

K"(X.) .028/8 .38 323 .04406 

R (P f l),T) = .41.162 . 





A 


Kl. K V-L-2 




1. Cohort 1 


Oimnona lily 
, Spring 1973/ 


;\na 1 ysis of SF.S — 
Ari thmotrc Tola L Score Ana 


lysis , 












Pre Lest 

(y) 


Dummy Codes (D) 


Teacher 
Variab 1 es ( 


U(X.) 

1 


.03532 


. 30089 


.0024 2 


C(P,D) 


.05 365 


.05365 




C(P,T) 


-.000 13 




-.0001 3 


C(D,T) 




.04079 


. . .04079 


c:(p,b,T) 


.01650 


.01650 


.01650 



2 • 

R (X ) . 10534 .411 83 • .05958 

.1 / 



R (P,D,T) = .4494,4 



V'-I.-l 
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TABLE V-I.-3 

Commonality Analysis of SES — 
Cohort 4, Spring 1972 % Arithmetic Total Score Analysis 



U(X.) 

L 

* c(p,d) 

C(P,T) 
C(D,T) 
C(P,D,T) 



Pretest 

.02514 
.0360 7 
- .00009 

.02547 



KdExAC; 
Dummy ('odes ( 0) 

.3369 3 
.03607 



.10316 
-*025A7 



Teacher 
.00169 



-.00009 
. 10316 
.02547 



i 



.08658 



50162 



R 0\D,T) = .52836 



1 3022 



tarke v- 



Commonality Analysis of SES - 
Cohort 4, Spring 1973, ' Arithmetic- Total Score Analysis 



Pretest 
(P) 



EdExAC 
Dummy ^ Code s ( D ) 

. 3431.1. 



Teacher 
Variabl es(T) 



U(X.) 
l 

c:(P,D) 

C0\T) 
C(D,T) 
C(I\D,T) 



.01855 
.04374 
.00047 

.02744 



.04374 

.11086 
.02744. 



.00044 

.00047 
. 1 1086 
.02744 



R CO 
i 



.09020 



52516 



3921 



fC(P,D,T) 



, 54461 
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> ( 

'I A \\\.\\ V-L-5 

Comrnona 1 i t y Analysis of SKS -« 
Cohort h. Sprint 1972, Ari rhmet: Torn! Score Anal vs Is 



i>>- 



Sr 



roLi'St ... KdExAG Teacher 



(?) 

i: (-V - .02 77 1 .23144 

1 r- t 

C(PJ)) .06119 • .06 119 

C(P,T) -.000 35 



JV 1 .™ 1 }'. . (: - 0,, )\ s /. !) .) Vnrinbh*s(T) 



.00228 

-.0003 5 
.".00 568 



C(P.n % T) V -.00097 , -.00097 -.00097 



R**(X) .OS75R 



■"8758 . ; \ ^97^ x .00664 



\ 



fr(PJ),T) = .'32698 



TAnLK V-l -6 



Cornmonal itv Analysis of SKS — 
Cohort h, Spring 197], Arithmetic Total Score An.ilvsis 



Pretest MdKxAO ■ Teacher ' 

(?) . . Dummy Codes (D) Variable (T) 



n «V .02116 .266A5 .0110S 

CUM)) .05837 .05837 



C(P,T) .00 H, 



' .00367 



<'<JD/n -.00055 - -.00055 

C(l\n,T) -.00829 -.00829 -.00829 



2 

R (X.) .07491 > .31598 .00588 



ir(P,0,T) - .35186 
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Commonality Analyses of Pre tost - 
•Arithmetic Total Score Analyses 
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TABU-: V-M-l 



Commonality Analysis of Protest — 
Cohort ], Spring 1972, Arithmetic Total Score Analysis 



U(.X.) 
i 

C(S,D) 
C(S,T) 

c:(d,t) 

C(S,I),T) 



i 



SKS(S) 
.04025 
-.00294 
• .00002 

-.00851 
.02878 



F-dKxAC; 
Dummy Codes (D) 

.07648 
-.00294 



.019 3*5 
- .0085] 



Teach « r 
.000 ;> r > 



• .00001! 

.019 n 

.008 5 1 



.01115 



ir(S,D ,7) = .1 249 5 



Cohort 1 



TAP, I K V-M-? 

Commonality Analysis of Pretest — 
, Spring 19 7 3 , Arithmetic Total Soorr Analyst 



U(X.) 
i 

c;(s,n) 

C(S,T) 
C(D,T) 

c:cs,d,t) 



R 2 (X.) 



SKS(S) 



.05224 
.04051 
.0000 5 

.01 254 



. 10 5 34 



KdKxAC 
Dummy Codes ( D) 



.07328 
.040 51 

• .00025. 
.01254 

. 12608 



Teacher 
ari ahl es(T) 

.00 728 



.000(J> 
.00025 
.'012 54 

.01962 



R*"(S,D,T) = , 18565 
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TABLE V-M-3 

Commonality. Analysis of Protest — 
Cohort 4, Spring 1972, Arithmetic Total Score Analysis 



S 



JJ(X.) 
" j. 

c(s,d: 

C(S,T) 

c(d,t) 

C(S,D,T) 

R 2 (x.) 



SES(S) 
.04 359 
.02507 
-.00009 

.0.1801 
.08658 



EdF.xAG 

.08914 
.02507 

.00219 
.01801 

.13440 



.00416 

-.00009 
.00219 
.0J801 

.02427 ' 



R (S.D.T) = .18206 



TABLE V-M-4 

Commonality Analysis of Pretest — 
Cohort 4, Spring 1973, Arithmetic Total Score Analysis 



SES(S) EdExAC „ Teacher 
1 _ P un«ny_ _Co des ( D ) Va r i ab 1 e s ( T ) 



Lr( V "° 3071 -34458 .01619 

.03938 



C(S,D) .03938 
C(S,T) .00142 



C(D,T) 

C(S,D,T) .01869 m .01869 



.00142 

00498 -.00498 



2 

R (X.) .09020 .19767 



.01869 



.03131 



R (S,D,T) - .24599 



■t\ 



V-M-2 
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TABf V V-M-S 



Commonality Analysis of Pretest: — 
Cohort 6, Spring 1972, Arithmetic Total Soore Analysis 



i:(X. ) 
i 

C(S,D) 

c(S, D 
cuvn 

C(S,!),T) 



K~(X.) 
I 



SKS(S) 

.05 384 
-.00007 

-.001 14 

.08758 



KdExAC 
Dummy Codes (D) 

.05457 
.05384 



.00298 
.0011 4 



Teacher 
_Vjiri;ib li*s(T) 

.0 1704 



- .0000 7 

- .0()2 ( KS 
-.001 14 



. 10429 



.00785 



ir(S,I),T) = .15121 



TAf»I.K V-M-6 

Commonality Analysis of Pretest — 
Cohort Spring 1973, Arithmetic Total Score Analyst 



U(X ) 
C(SJ» 

c:f s,T) 

C(D,T) 
C(S,D,T) 



SKSfS) 
.02409 
.05466 
.00397 



.00781 



!T(X.) 
i 



.0749 1 



KdKxAO 
Dummy Codes (0) 

. 16775. 
.0 5466 



.0 1 2 34 
.00781 

. 22694 



Tea u-r 
V^ i ah lo_s(T) 

.00710 



.00 39 7 
.0 1 2 3 i 
■ .00781 

.0 1 559 



lOSJM) = .26210 
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Appendix V-N 



rntercorrelat ions Amon« All Key Analysis Variable? 
Arithmetic Total Score Analyses * 



*Var i 
Methods ti 

lacions vary depending 



names for the abbreviations used are found in Appendix IV H. 
used for testing the statistical significance of these corre 
upon whether or not the variables were measured at 
the student level or at the KdKxAC 
in Chapter IV and in Appendix IV-K. 



.^roup level. These issues are discussed 



Critical values for the correlation. 4 
pretest and posttest are found in Chapter V in the body nf the r 
the critical values for correlation amon 
Critical values for intorco rre 1 at ions c- 
level variables are noted on each of th. 
effective, sample size, k rc (see 'ppendi:-; 



exceeding the noted value^are statistical 



with (k 



f f. 



•2) decrees of freedom. 



of the Kdl-xAC variables with SKS, 

eport as are 
the student level variables. 
!:<A(;- level variables with EdKxAC- 
i lowing tables, nlon^ wrth the 
IV-K). RdF.xACi variable correlations 
y signi Meant at p .05 (two-tailed) 



TABLE V-H 



n 



'.Vi!?! 



Intercorrelatkis anions; the Key Analysis Variables 
Cohere I, Sprin;, 1.972 Arith. Total Score Analysis 

f r (p<.0V) = ,576 , k . e = VI \ 
erf 



tr",:i;i x 



..Ij! -.'Ti';,i 



i.umo ;].n,'u . 0 ,,ir>:;; a mi. i --hi' 

9.16165 ,1.1 Hi; im\ -UlN? 

MWN □. IbloS I. WW] 1,'niM ■/mi,. 

' --»■ 005*5 uws; i,iiou unr. iPP 
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APPENDIX V-0 

Commonality Analysis Tables 
for the Degree of Individualization Growth Mode 
Arithmetic* Total Score Analyses 
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TABLE V-O-l 



Commonality Coefficients* for the Degree of Individualization Growth Model — 
Cohort 1, Spring 1972, Arithmetic Total Score Analysis 



Commonality 
Coefficient 




SES(S) 


Pretest 

(P) 


EdExAG 

Variables 

DI and NMIN(E)** 


Teaching 
Qualif i- 
cations(T) 


u(x 1 ) ' 


( 


.08283 
.34058) 


.10585 
(.43527) 




.00597 
.02455) 


.00016 
(.00067) 


C(S,P) 


• ( 


.04384 
.18029) 


.04 384 
(.18029) 








• 


C(S,E) , 


(- 


.004 77 
.01962) 




(-: 


,00477 
,01962) 






C(S.,T) ( 


( 


.00060 
.00245) 










,00060 
.00245) 


C(P,E) 






.01189 
( .04888) 


(. 


.01189 
.04888) 






C(P,T) 






.00063 
(.00257) 






( 


,00063 
.00257) 


C(E,T) 




- 




(. 


.00033 
.00136) 


(, 


.00033 ,;-> 
.00136) V 


C(S,P,E) 


(- 


.00251 
.01034) 


-.00251 
(-.01034) 


(-! 


. 00251 
.01034) 






C(S,P f T) 


r- 


.00101 
.00416) 


-.00101. 
(-.00416) 






(- 


.00101 
.00416) 


C(S,E,T) 


■ ( - 


.00056 • 




(-. 


.00056 
,00230) 


(-! 


,00056 
.00230) 


C(P,E,T) 






.00074 
(.00303) 


■(. 


,00074 
,.00303) 


( 


.00074 
.00303) 


Co, P,E,T) 


r- 


.00078 
.00322) 


-.00078 

(-.00322) 


(-. 


,00078 
00322) 




.00073 
.00322) 






.11763 


. 15864 




01029 




.00010 






o 
FT 


(S.P.E.T) = . 


2431 9 









R"(S,P,D,T) + « .32758 ' 



* Below ea- h commonality coefficient and in parentheses is the normalized 
coefficient; that is, the commonality coefficient divided by R 2 (S,P,E,T). 

**DI and XMIN are abbreviations for Degree of Individualization and Number 
of Minutes per Day. 

4- The multiple correlation squared of posttc.iL vit.h SKS, pretest) the dummy 
variables encoding lUlxAC group ncmb^rsh i p and Lhe three key teacher* 
var iab les . 



i 
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TABLF. V-0-2 



Commonality Coefficients* for the Degree of Individualization Growth Mode 
Cohort 1, Spring 1973, Arithmetic Total fecore Analysis 



Commona Li ty 
Coefficient 



U(X.) 



c(s,n 
c us , i-:) 
t:(s,'i") 

C(!\F.) 
C(1',T) 
C(E,T) 

i:(.s,i»,l) 
C ( s , p , r/) 
C(S,K,T.) 
;' ? C(P,F.,T) 
C:(S,I\K,T) 



SES(S) 



.00000 
(.00000) 

.04238 
(.0/681) 

.0001 7 
(.00031 ) 

.00007 
(.000J 1) 



k *"(:<. ) 
i 



-.00044 
(-.00079) 

.01112 

( .0201/)) 

-.00024 
(-.0004/0 



.0UL61 
(.00292) 

.0^4-1 7 



,.45762 
(.8-2942) 

.04 2 38 
(.07681 ) 



-.00214 
,(-.00389) 

.01 100 
(.01994) 



-.C0044 
(-.00079), 

.011 1 2 
(.02016) 



. 00248 
(.00449-) 

.00161 
(.00292) 



.52362 



Pretest EdExAG 

(P) Variables 
PI and NMIN(E)** 



Teaching 
Qualifi- 
cations (T) 



A"(s;i\r;,T) - .55173 
R~(S,I\n,T) + = .6^544 



(.03742) 



.0001 7 
(,00031) 



-.00214 
(-.00389) 



.0034 2 
(.00619) 

-.00044 
(-.00079) 



-.00024 
(-.00044) 

.0024 8 
(.00449) 

.00161 
(.00292) 



.02 5 50 



.00405 
(.00733) 



.00007 
(.0001 3) 



.01100 
(.01994) 

.00342 
(.00619) 



.01112 
( .0201.6) 

-.00024 
(-.00044) 

.00248 
(.00449) 

.00161 
(.00292) 



.03351 



* P^lnv: t ',-irh common, i J i r y coefficient and in parentheses is the normalized 
rori'l i c i rru ; th.it is, tlu- rommonalitv coefficient divided by R 2 (S , P , K ,T) 
ami N'MI*. are abbreviations for' Decree of individualization and Number 
< » I M i nu ties pc r [)av . 
+ The multiple correlation squired uf pnsM.f-.;t v; i L I: SI'S, pretest, the dumf 
variable:; encoding EdE:-:A(i ^ronp member ;;h i p and th<- tr.i-'e key t earlier 
var i ah 1 . 
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TABLK V-0-3 

Commonality Coefficients* for the Degree of Individualization Growth Model- 
Cohort 4, Spring 1972, Arithmetic Total Score Analysis 



Common a l i cv 
Coo t'f ici en t 



l'(X.) 
1 



C(S,P) 
C(S,F ) 

c: r (s,T) 
c(p, ) 
r ( p , r ) 
c (I-M) 
* IS,1\[ 
C(S,1\T) 
C(S,i-\T) 

c(p, i:,t) 



SKS(S) 



.00416 
(.00654) 

.08219 
( . 1 29 3 3) 

.00006 
( .00010) 

.000 76 
( .00 1201 



.00 236 
( .00 37 1 ) 

.00157 
{ .00248) 

-.00008 

(-.ooo m 



-.00082 
(- .001 20) 

.090 21 



Pretest 
(P) 



.5 3941 
(..84878) 

.08219 
('. 129 33) 



.00499 
( .00 785) 

- .0006 7 
( .00105) 



.002 3h 

( .oo 3/ 1 ; 

.001 0 7' 

i . 00248) 



.000 31 
(' .00049) 

- .00082 
(-.00129) 



. ^29 3; 



KdKxAG Teaching 
Variables Qua'lif i- 

HJ_and__NMIN(E)** cat ions(T) 



.0007 7 
( .00120) 



. O0OO6 
(.00010) 



.00499 
( .00785) 



-.00018 
( - .00028) 

.002 36 
( .00371 ) 



- .,'0008 
(-.00013) 

.00031 
( .00049) 

-.00082 
(-.001 29) 



.00741 



.00068 
(.00107) 



.00076 
( .00120) 



-.0006 7 
(-.00105) 

-.00018 
(-.00028) 



.00157 
( .00248) 

-.00008 
(-.00013) 

.00031 
(-.00049) 

-.00082 
(-.00129) 



.0 "158 



!";~(S J\l-\T) - .63552 
iC(S,P,n,r'»" r = . f-.38.Vt 



Bel,v.v ..,.•!. oomnhuiality cooffk-n-nr and ,n parentheses is the nornn'l izc-J 
cu-t : i. u-nt; thai is, tin- .-.on-naai i t v anl i i o ient tUvidcd by r2(S,I\E,T) . 

DI ;lnd N ' M1X -f 1, .*l'rt-vi.»tl.- : - D-,;r,o of Individualization and Number 
ol Mi null's pvv Day. 

+The multipli- correlation squared -f r^llrst with SKS, pretest, tho dummy 
variables encoding KdKxAC 5; roup "u-nbership and the- three kev teacher 
var i abli s . 



TAB I.!-: V-0-", 

t.y Coefficients* fur the De^roo T nd '. v i dua 1 at i on On wt h Model 
ehort A , Sprin>; 19 7 Arithmetic Total Scnrv Anal vs is 



t v 
lit 



SKS(S) 
. 00 A Ah 

( .oobb n 

.08621 
I . I 2829) 

.000 17 
( .()()02h) 

.000 1 1 
( .0001 7) 



.00 7 19 
( .01069 ) 



* -.00 1 i 1) 

- .0000 [ 
(-.0000 2) 



-.000 7 7 
f- .00 J 15) 



Prot osl 
(I 5 ) 

. "> eS22 

( .81 ;83) 

.0862 1 
I . 1 2829) 



;aIKxA(I Teach i ny, 

Yar i ab 1 os Qua 1 i f i- 

1)1 and NMINO,)** rat ions(T) 



.O22(o 

.( .o i2sn 

.0009 '; 
( .00! ..0) 



-0(i 7 19 
t. .0 1069) 

- .000 7 5 
(- .00 111) 



. 00 ] iO 
i . w0 306) 

- .00077 
(-.00 J 1 5) 



.00066 
( .00098) 



.000! 7 
{ .0002^ i 



. 02 20 5 
( . 0 5281 ) 



- .00010 
(- .0001 3) 

.007 19 
(' .0 1069) 



- .0000] 
(-.00002) 

.00'UO 
( .00306) 

-.000 7 7 
(-.001 15) 



.000 18 
( .00027)'. 



.000 1 ( 
( .000 1 7) 



. 0000 A 
( .00 1 AO) 

- .000 10 
(- .000 1 5) 



- .000 7S 
(-.001 1 1 ) 

- .0000 i 

I - .0000 2) 

.00'* AO 
( .00 306) 

- .00077 
("- .001 1 3) 



.09660 



. n66A9 



.0 '32 59 



.00 JO 1 



s , p, [•: , n - .67196 



'•'M-r I Lei <-nt -i:id in paren tihe^.s is tin henna 1 i ;:od 
t-ii-it- » o^r.ena 1 i t y coef f i c i en t ci i v i cii.-d bv ( S , !\ K ,T) . 

IN ire abbn-v i at ions l\,r !.K;:roc of I nd v i dua 1 i ;-:at i on and Number 
s :>er Day. 

pie correlation squared of postLest with Sl-S, pretest, the dummy 
•■ri'-edin:/ ld::-;A0 c.roun m» --be i; -di i }- and the tiire? kev teacher 



J v) i 



(Sommona I i t v Coeff ic i cats* tor the Decree of I ml i v i dua 1 i za t i on Crnwth Model- 
Cohort 6, Spring 1972 , Ar i t lir.ua i r Total Score Analysis 



Cor.Miiona I i t y 
Coe t" I i c i en t 



r(x.) 
i 



C( S,P> 

r rs , : ) 
'( s , ;■*) 
(:'( i\ n 
i'(!\T) 
C'l'K,T) 

a s , r , ; ) 

('( S , i' , 1") 
C(S, i , i ) 
C(V , F. ,T) 

as 



i 



SKS(S) 

oo 3 52. 

00526 ) 

0 7 708 
! 1 308) 

00098 
DO 14h) 

00 01 :; > 



.004 '31 

( .onhvn 

.0009^ 
l .00 14 1) 

.000 21 
( .00011) 



-.00 1.0 2 
(- .00 152) 



.08 J9 2 



Fret i'st 
(F) 

. 56 38'i 
( .84 18 3) 

.07708 
(.11 : >U8) 



KdKxAC; Teaching 
Var iab 1 es Qua 1 i f i- 

01 and NM1N(K) ** cat i«ms( D 



.01 822 
i .02 7 20 ) 

- .00062 
( - .0009'}) 



.004 31 

( .00643"; 
.0009/4 

{ .01 1 1 '• i ) 



.00002 

( ,0000'}) 

-.Of) 102 
( - .00 1.52 ! 



.66 2 76 



.00378 
( .00565) 



- .00098 
(-.00146) 



.0 1822 
( .02720) 



- .00016 
(-.0002 3) 

.004 31 
( .0064 }) 



.00021 
( .00031 ) 

.00002 
( .0000 3) 

-.00102 
(- .00152) 



.0 24 39 



/ 1 S,1\K,T) 
S,F,I), 1')" 



. h69 77 
689 75 



.0007 7 
( .001 1 5) 



-.000 1 5 
( - .0002 2) 



- .00062 
(- .0009 3) 

-.00016 
(- .000 2 3.) 



) 

.00094 
( .00 1 4;1 ) 

.00021 
( .000 31 ) 

.00002 
( .0000 3) 

- .00102 



.00000 



lit. 1 low each commonality coefficient and in parentheses is the normalized 
coo! f i c i out ; that is, Lin •.■ommona 1 i ' y coefficient divided by R^ ( S , F , | ; . ,T) . 

[)I and NMIN are abbreviations for Decree of Individualization and Number 

of M i nut" es per Day , 
+-The multiple c.orrelat Ion squared of posltest with SMS, pretest, the dummy 

variables oncod i n^, rldr.xAO ^roup membership and the three key teacher 
. var Lab les . 



i AH!.:. \ -t 

ni.i lie*. !' i <• i\-:it s* lor^iu- !).:};!>,• ul i nd i v i dna I : ... > \ [ on Civwi ti 

l>l>li ^ rL n < Spring iw/i', Arit h::iot ie l-tal Sror e Ana 1 vs i .-. 



I'^H' !' ! i i" i iMll 



i\ s , i: ) 
i - i s , ; ) 

n i\ ; i 

(a s , \\ ;■■ ) 

i'( S , I 5 ,7 ) 
C( i\K,7) 



.Oil 

( . 00 ' ; :-.) 

. (.*:•* -o 

{ . 1070.; ) 

. ooo v. 

I . 1)007 i j 

. 001. 0 J 
( . 0O0O J J 



I'ivi esr 
i P.) 



KdKxAC 
Var iab 1 l-s 
DI and NMTN (!■;)' 



(Ju;i 1 i i" i- 
ra r ions ( T) 



.0040 5 

( .00 n) 

-.0000..' 
I - .0000 2 ) 

-.00018 

i - .ooo:2">) 



-.00240 
( - .00 32-4 ) 



. 58 3 n 

. 0 7^40 
{ . 10 704) 



.0'. 7 58 

\ .Of,'.]',. 



< .000 1 )) 



. i;o:+o * 

I .00 34 ( ) 

- . 00()i»2 
( - .oi)002 ) 



.01672 
( .02254; 

- .00 2 AO 
.-.00 324) 



.00702 
( .009 Ah) 



. 000 54 
( .000 7 1) 



.04 7 58 
< .064 1 ")) 



.000 n 

( .00044 ) 

.00403 
( .00546) 



- -noni« 
(-.000 25; 

.01672 
( .02254) 

—.00 240 
(- .00324) 



.0001 5 
( .00021) 



. 00002 
( .00002) 



. 000 1 1 
( .000 15) 

.000 '3 3 
( .0004*)- 



- .00002 
(- .00002) 

-.000 18 
(-.000 2 5) 

.01672 
( .022 54) 

-.00240 
( - .00 324) 



.08450 



/ < 0 7 



.07365 



.01472 



H tSJVVO = .74 174 
fT(S,FVVO + = .75048 



hc ' K ^/' ;n ' h •'^inor.ai it v ,:-..o f i r i t-n r :md Ln pa renthos.-s is the normalized 
'^•■f! i.-ii-nt ; chat is, r!u- corona 1 i t v roof f i o iont divided bv K 2 fS P }•' T) 

1)1 and WMIN nr.- :ih ! n v i;it inns for [H-rcr oi I no i v idua 1 i :»a t ion and Number 
(> ' Mi- it **s pt-r I'.iv . 
~ H; ''" multiple o..rr- '-'inn squarvd i.r pnstu-.r with SKS, protest, t \n> dnnmiv 
v iriah ]••:-; oiv-nd in;; LdKy.AO I'.nuip memhe rsh1 p and the throe kev teacher 



uilMi S . 



APPENDIX V-P 

Comparison of Key Anal ys is Variables 
for Positive and Negative Outlier Ed Ex AG Croups 
from Cohorts 4 and 6 - Arithmetic Total Score Ana'yses 
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TAKI.E V-P-l 
Comparison of Key Analysis Variables 
for Positive and Negative Outlier Ed Ex AC Groups- 
Cohort 4, Spring 197?,, Arithmetic Total Score Analysis 



V iriable 

Number of Student.* 

Pos ties t Res id- 
ua 1 i ved* for Pre- 
test and SKS 



Pretest ( Nat Lonal 
Xorm=4P0) 



Norm =4 40) 



At t i t udo toward 
Math SP71 



A 1 1 i Lucie 1 i >wa rd 
Ma tii SP72 



SES 



Ethnic Group*' 
(wh i te=l ; non- 
wh i te=0) 



1 Index of 



kevaicss 





I - . - 


N ♦ • i ■ 


it. i Ve 


Our 1 


i i ■ r ^ 




4 - 


Pos i 


Great L'st 
I i vi* Out 1 


j t • J" s 




1 


4 8 




.18 




24 




L0 


22 


1 1 7 


X 


-•'() 

- 


.09 
• 


- 26 




- "> 7 


Q 1 

.7 J 


Zh 


') ' 
. )a 


25.4^ 


2 . 2 A 


sd 


JO 


. K) 


29 


.92 


46 


.93 


1 3 


. 87 




'A i 9 7 ' 
♦ O , Z / j 




-0 


. 27 


0 


.12 


~ J 


. 15 


0 


.55 


0 . 1 5 


i 


X 


4 1 3 


. 00 


399 


"30 


'j ] A 


Q 1 


A ') 1 




3 91.7 7 


40' .vj. 


so 


34 


.21 




.93 


30 


. 6 7 


26 


. 54 


J 8 . 9 7 


. f 1 

'.-4 1 




-0 


.81. 


0 


. J9 


-0 


.44 


0 


. 37 


0.17 


1 


X 


4 34 


.98 


4 1 3 


. 4 1 


4 2 h 


. 6 4 




n l 


A c A 7 n 


•4 b6 . 


SD 


49 


. 16 


49 


.23 


4 4 


.93 


33 


. 3 3 


61 .01 


j 

6 4 . 2 n ' 


K • 


-0 


.00 


0 


. 7 4 


-1 


. 14 


0 


.43 


0.34 


0.12 


X 


100 


07 


1 02 


n i 


i n a 




li ; ? 


. 3 j 


9 7,4 4 


100 .1 2 


SD 


8 


.98 


9 


2 3 


9 


3 1 


8 


. 31 


10.98 




<. » 


-0 


34 


-0 


6 4 


-1. 


74 


-1 


91 


-0 .08 


-0.4P 


X 


97. 


69 






104. 


46 


101. 


29 


100 . 83 


99 .73 


SD 


8. 


46 






8. 


32 


ft 


1 A 


1 1..04 


10 ,22 




-0. 


) ■> 






-L. 


4 3 ■ 


-0. 


84 


-0.55 


-0.35 


X 


96. 


40 


97. 


44 


89. 


1 

87 ; 


94. 


94 


9 3.60 


.104.81 


SD 


5. 


L7 


6. 


1.6 


5. 


98 ! 


6. 


83 


6.78 


8.36 


< T 

H 


0. 


69 


1 . 


0 5 


0. 


19 j| 


0. 


88 


1 , 30 


•0.3, ! 


X 


0. 


98 


0. 


60 


0. 


92 jj 


1. 


00 


0.9 5 


0.89 




















(continued) j 



-For binary codec! \. .i r i ab 1 er; the X is equal to the. 
proportion of stu-NuLs coded with a "1." 
v Note: Klank entires indicate no data collected.' 
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, where g - skewness index, 

x = deviation of a score 
from X, where X is an 
EdExAG-group mean for 
var iab le X, and 
N = number of students. 
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TABLF. V-I'-l (continued) 



Variable 

So/ X 
(gir.l- : 1 ;boy=0) 

I't i I i za t ion of 
Ob j or l Lves 

I mi iv Ldua 1 1 :*ac ion 
in Pec i. . ; i o n Ma k i. n g 

T cache r • ,v Loca I ly 
developed Materials 

IndL vidua Liza tion of 
I n-. true t j on. 1 1 Pace 

:■ chethi mg Chn rne- 
f ( • r i t: I c s 

Use of Performance 
Agreement, s 

Classroom Group 
Organ i zat ion 

Teach ing l'n i L 
Compos i t i on 

Completeness of 

Ins true t iona I Package 

I'r LI iza tion ot 
Student Evaluation 

4 \o v e 1 of Inn ova tion 

Degree of 

I nd L vi d ua 1 i za t i on 

Number of School 
Days pe r 'rear 

Number of Minutes 
per Day 



Great est \ 

ibr'&L^SSy^ t 1 i c_TS - 

.44 0.5 3 0.4? 



Great f.^t 
Pus i f ive Out 1 i * rs 



'3.00 



2.00 



.00 



2 .00 



.00 



1.00 



4r> 



3.00 1 .00 



i.'b7 1.00 1.00 



.00 3.00 



3 . 00 



1.00 



0 .70 



.00 



I . 00 



.00 



.00 



.00 



.00 



2.00 3.00 1.00 



50 2 00 



:.50 1.50 



3.00 1.67 



1 . 50 



20 

7.67 10.00 A. 67 



0.36 0.57 



1.00 1.6 7 



1.00 3.00 



1 .00 



2.00 1. 00 



3 5.63 



3.00 



.67 



I I . 50 1 . 50 1 .00 I L i; 0 2.00 2.00 

i i 



1.00 2.00 



.00 



1.00 2.00 



.00 L.00 2.00 



.00 



2.50 2.50 



2 . 33 2.67 3 ; 0 



17 25.50 12.17 13.33 14.83 23.17 



8.67 



180.-00 180 .00 180 .00 180 .00 180 .00 200 .( ) 



V i. > r bin; i r y c o d e d v a r i ah 1 e 
coded with a M l . " 



,00. 50.00 4 5.00 45.00 60.00 42.00 

, i _ ( c on t i n u e d 

> the X i s equal t;o Lite propor t ion of st udents 
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TABU- V-P-l continued) 



Var lab le 



( • r . • . 1 1 . • t 
Ni'viai i vf Out 1 i -.T s 



\ T i:mb<.T of iV.irln.TS \ i .00 



. I i\u" hit s : \ 



,00 



L.00 



X AO. 00 24.00 50.00 



loach cm' s So -in- X 96.00 98.65 9 1.11 
e<'onoin i c ft. k^ro'ind 

1 each ir • ;.u if - X 112.76 SO. 8 J 1.08.1.4 
cat ions 



( r.'at -st 

*!.i\ s JLi ]yv..l ) ! i J.J i <t^_~ 

1 .00 1.00 4 .00 

50.00 14. 1.8 40.00 

91.1 i 97.37 100.83 

109.66 9 7.49 10 3.74 
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TABLE V-P-2 



Comparison of Key Analysis Variables 
tor Positive and Negative Outlier IidExAG Groups — 
Cohort 4, Spring 1973, Arithmetic Total Score Analvsis 
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73 
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31 
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O . LU 
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542 . 


65 
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. Ab 
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4 6 5 


. 80 


No rm=440) 


SD 


48 


.08 


48 


- 83 


35. 


52 


52 


.01 


5 7 . 38 


38 


87 






0 


. 73 


-0 


.72 


0. 


36 


—0 


1 5 ~~ 


1 . 54 


-0 
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v 
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. i J. 
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.88 


Norm=4 7b) 

i 


SL) 


46 


.47 


54 


. 72 


32. 


86 


68 


. 27 


49 .21 


45 


. 25 


i 

| 




0 


.23 


-0 


. 20 


0. 


16 


-0 


. 17 


0.97 


-0 


.68 


i . , 


V 
A 






Q ft 


o 


101. 


46 


y j 




7C 


94 


. 4 3 


1 Math,' SP72 

i 


SD 


9 


. 5b 


8 


. 84 


9 . 


60 


10 


.92 




9 


. 68 


1 
i 


o 
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. I 3 


0 


.0 h 


-0 . 


61 


o 


. 2 3 




0 


.-Mi 


Attitude toward 


X 
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. L8 


94 


.26 


107. 


24 


98 


.47 




9 3 


.57 


Math, SP7 3 


SI) 


1.0 


.31 


8 


.00 


7. 


6 3 


1 1 


.00 




8 


. 17 






-0 


,8b 


0 


. 5 1 


-0. 


72 


o 


.31 




0 




si-:s 


A 


10 5 


.67 


108 


.67 


L08. 


71 


9] 


.60 


100 .42 


110 


. 19 




SD 


8 


.48 


8 


.66 


7. 


14 


5 


.42 


9.17 


6 


.00 






-0 


. 58 


-0 


83 


-0. 


75 


-0 


.36 


0.70 


-0 


.85 


Ethnic Group 


X 


0 


96 


' 0 


. O > 


0. 


96 i 


0 


.86 


0.65 


0 


.98 


( wh l te= 1 ; non- 
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^Inde>: of skevnoss 
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SKUWIK'.S.S ill tiO.'. 
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^For binary eoued variables the X i r: equal, to r ho 
• proportion o(f students coded with a M L." 
*\'ott*: lilunki entries indicate no data col looped. 
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deviation of a score 
f_rom X, where X is an 
Ed BxAG- group mean tor 
varjiable X, and 
number of students. 
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!"ABLK V-2-P (i-i 



n t i hued ) 

\ 



Var i ab 1 e 



Sox 

"(«irl= I ;bov=0) 

I; t i 1 i xat ion o i 
Objectives 

I ml i v i dua 1 i ::a t ion 
i n Deo i :■» ion Mak i tic 

Tea e he r or I. oca 1 1 v 
Deve b>ped Mat La* ia 1 s 

I nd i v i cua I i za t i on of 
I nstnu't iona 1 Pace 

Sohedu 1 i nj: (!ha rao - 
. Lor is t i i"s 

t t'sc of Per t ordnu'c 
j Agreements 

I 

Classroom Oroiui 
' 0 r^in i z a t i on 

I Teaching ("ait 

! Compos it ion 

! 
i 

I Completeness of 

I InstrucL iona I Package 

Ul Liizat ion of 
Student Kvn Luat ion 

Level of Innovation? 

Degree of 

Indi v i dua I i za t i on 

Number of School 
Days per Year 

Number of Minutes 
per Day 



I. *a » r 
_ Negat i vv Cnu 1 i . r s 

0. 50 0. (.). A 7 



.00 



:.oo 



LOO 



2.00 



3.00 



2.00 



50 



2.33 

23. 17 
( ) .66 



L00 3.00 



.00 



2.00 



3.00 



.00 



3.00 



2 .00 



30 



.00 ' 2.30 



3.00 

2 4. 00 
10.0(1 



.00 



I . 30 



.00 



1 .00 



1 .00 



I .00 



.00 



1 .00 



3 '30 
6.00 



200.00 200.00 200.00 i 



Orea l .-st 
IV-' i t ive Out i it.-r 



0.43 



1 .67 



i.o; 



.00 



2.00 



2.00 



2 . 00 



2. 30 



2.00 



19. 30 

7 u 



0 . 72 0. 30 



3.00 



.0(J 



. 30 



2.00 2 .00 



.00 



1.00 



1 . 30 



1.67 2.00 



20 . 30 
7.00 



1.67 



.00 



:. 30 



3.00 2.00 



.00 



:.oo 



.oo 



00 



2.30 2.00 



2.6 7 ; 
16.83 ! 

LI 

7.67 . 



182.00 180.00 J82.00 



30.00 50.00 50.00 j 60.00 V .00 60 00 

; I 

i ._._< [ ( ( '° 11 L i nued ) 



For binary coded variables the X is equal to the proportion of students 
eoded wi t h a M ]. . " 
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TABI.K V-i'-J (, ,mU imu-cl) 
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i 

OS I f 


. r,- u r 
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« • r s 


Teacher /Student X 


\ . 
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so 


v 
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38 
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■) 


00 
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1 .00 


Teacher ' 


s \^ \ X 
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00 


JO 
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00 


'JO . 00 


AO .00 
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A 1 l ) S . 


% 
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OA 
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Mh . 
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17 
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ft 5 


1 0 S . .'♦ 5 


100 . 1 2 
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Re 1 a L i Vt' HUMS urt; o i" LC 
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r/studenl 
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1 to t 


ho p 
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Lint- per individual sLudent. 
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Co:r,par ison of Key Analysis Variables 
for Positive and Negative Out 1 it. r EdKxAO Croups- 
Cohort b, Spring 19 72 , Arithmetic Total Score Analvsis 



Va r i ah { e 

Nuniln-r of Student: 

Post t est Resid- 
ua 1 i ::.-d fer Prr- 
lest and S!:S 



m-::- * 7n) 



1 Post l est ( I liter- 
po I a t ed Na t i una 1 



At. t. i t tide tow ) I'd 
Ma t'n, Si 1 7*1 



At t i I ad.' rov;a<r"r 
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(wh i u \l ; non- 
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* " ' * \ 
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-0 
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79 
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0 
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-0 


. io 
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-. 
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ah 


340 
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so 
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0 
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0 


.0 3 


0 . 5 1 




-0.4 7 


A 


100 . 89 


9 8 


so 


UH 


2 J 


i 04 .42 




10 2'. 90 


SD 


9 . 29 


U 


59 


8 


SI 


9 . 52 




9 , 59 


,K 


-0.0 \ 


* J . 




-0 
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-0 . 52 




-0.42 
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'if) 


102. 2-, 




98.h J 


SI) 








9 


19 


11.37 




9.63 ! 










■ -0 


2-4 


-0.23 




0.15 ; 




100 . 3 i 


99 . 


16 


10 1 


9 a 


9 3 . 9 4 




108.9 3 


Si) 


9 . 35 


8. 


S ' } 


12 


1,2 


7.79 




6.83 


;t 1 


0.21 


o . 




-0 . 


70 


0 . 28 




- 1 .20 i 




0.82 


0 . 


1 


0 . 




0.18 1 




0,9 8 ! 








| 






( i'on t 


inni'tO ! 



1 



Inde:; of skevaa 



* ; - Fo r h in.i r 



> waere y -■ .mj.'U'iil'SN hid. 



IT I al) K t he X h; * 1 1 



proper t i u:} ot :;l na« at s c 
'Xv Me: 11 1 a nl> ail r i » [\u 



,M th :< 



i ua J 

n , m 



t!lf 



deviation of a score 
from X, where X is van 
EdExAG-group mean f or 
variable X, and 
number ot' s indents . 



n«« data eul !■ 



TABLK V-P-3 (rmit : 



Var i ah le 

Se.v 

B (^irl = L;boy=0) 

L't il i 7.i\\: ion 
of Ob j ec t i vos 

End i v i dua 1 i za t ion 
i n Dec i s ion Mak i ng 

Teacher or Local ly 
Deve loped Ma t or i a 1 s 

Individualization of 
Inst ructional Pace 

School i j 1 i nj; 
Gharacterist ics 

U s o o f p o r f o r man < - e 
Agreement s 

C 1 ass room Group 
0ri;an i za t ion 

Ton oh i n >; i'n i t 
Compo i t ion 

Completeness of 
Instruct Lonai Package 

Ut i. 1 i zat ion o f 
S t nd e n L K v a 1 n a t i on 

. vo 1 c f T nnova t ion 

Decree of rndiv- 
i dua 1 i za t i on 

Number of School 
Davs per Year 

Number of Minutes j 
per Day | 

■ For binary co.Jed vfiriab 
codes'- i*' I l a :i ! . " 



Great e s L 
No gat ive Out 1 iers 

0.4 7 " 0.56 



"3.00 



24.00 
L0.00 



.00 



2.00 2.00 



1. 50 2.00 



'J. 00 J. 00 



i .00 1 .00 



3.00 2.00 



J. 00 3.00 



3.00 3.00 



50 L.50 



2.00 1. 00 



19 . 30 
8.00 



180.00 1.80.00 



fV. .00 30.00 60.00 



Greatest 
Pos i t ive Out 1 i ers 



— s 



0.51 
3.00 

1 .00 
3 . 00 

2 .00 
3.00 
3.00 
1 .00 

1 . 50 

2 .50 

3.00 

23.00 
9 .00 



0.55 

3.00 

1 .67 

L .00 

3.00 

1 .00 

3 . 00 

3.00 

1 . 50 

3.00 

2-00 

22.17 
9 .67 



180.00 180.00 



60 .00 



0.49 



3.00 



1 .00 



2. 50 



2.00 



3.00 



2.00 



3.00 



1 .00 



:.oo 



3.00 



8.00 



180.00 



30.00 



Les thi' X is equal to the proportion of students 
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TABU;' V-l'-J (roiuinuod) 



Variab lo 
Xi' er of Teachers 



I'oa •'• ■ - r 1 ri Ago 



Teaciuir's Socio- X 
o c on o n i i v P> a e k ^ r cm n d 



Orcat ost 
Ne_gat ivo_Oul liers J 



1 .00 
30 .00 
L 10.9 I 



Toarh Lug Qua 1 i. f i • 
eai Ions 



1 .00 
50.00 
9 1.11 



X" i 99 .A > lOfi .68 : 



37 .03 
100 . 18 



Circa tost: 
^ ,(1< :4tiyc» Out 1 io rs 

I ,1.00 3.00 

r )5 .oo -V3 . n 

9 3.1 A 9 A . 4 3 



T 10.71 



I 08. A i 



i / 4 
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TAH1.E V-P-4 , • 

•Comparison of Koy Analysis Variables 
for Positive and Negative Outlier EJExAC Croups- 
Cohort 6, Spring 1973, Arithmetic Total Score Analwsis 



Var i ah le 

Number of Students 

" Posttest Resid- 
ua 1 i ;:ed f o r Pre- 
tt-st and SMS 

, Pretest (Inter- 
polated Na t iuua ! 
Norm=509. Vj 



i Post tes t (Nat ioua 
! Norm=545) 



c:?-. 
No>;a? i • 



At t i tude tow 
MaLh, SP72 



At t i t uile t uwun 
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SKS 
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E L h n i o 0 roup 
( vli i t e= 1 ; non- 
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indox of ;;]:. 



X 

SD 
... 1 

A 

SD 
X 

X 

SD 



:ht! 1 iers 
2 ' 36 



-12. 3" 
3 3 . SO 
-1.47 

34 3.^3 
hi .24 
0. IS 

351 .47 

66.28 
-0.21 

10.1.6 3 
9.14 
-0.1K 

X L01.6 3 
SDi 9.17 
« | -0.^2 

1 102.2 1 
• 1L.63. 
-0.7 5" 



X 

SD 



v 



0. 80 



-13.25 
w . 12 
-0. 7 3 

4 7 5.33 
4 3.12 
0 . 6 1 

48 7. 4 h 
h 3. 7 1 
0 . 2 5 

9 7.85 
1 i .06 
0. 31 

101 .94 
9. 88 
-0.09 

1 03.1 1 
7.90 
0.09 

0.7 3 



-14.S2 

:\u. 74 
-0.82 

4 50. 2 3 
26.07 
-0.13 

4 38.4 7 
37.6 3 
-0.10 

98. 7 3 
10. 76 
0.2 3 

1.00.40 
9. L2 
ft-. 02 

94.7 3 
8.83 
0.16 

0. 39 



< i rea L i-s t 
; i t i ve Out 1 i ers 



37 

16.13 
42.42- 
- 1 .65 



0.48 

537.62 
7 3.88 
-0.26 

98.62 
10.36 
0.19 

100. 36 
9 . 2 5 
0.12 

105.74 
8.62 
-0.52 

0.73 



1 1. 78 
4 3. 16 
-2. 19 

550.4i 
66.31 
-0. 34 

578.72 
70.92 
-0.93 

10 J .57 
8.75' 
-0.27 

10 1 . 36 
9.92 
-0.27 

96.04 
6.55 
0 . 7^ 



29 

LI. 22 
32.18 
-0.03 

553. 18 
54.25 
0. 31 

586,74 
6.1.70 
-0.48 

98.84 
10.68 
0.20 

LOO. 76 
11.23 
-0.12 

108.84 
5.98 



-0.84 | 

i 

0.96 1.00 1 

I 

( continued)! 



r o r b l is n ry e<»' 
propur t i <>n <> i 



•d var i ah K-.- (he X i <: 
; t uden f ■; roiled w i t h a 



•qua 



V-P- 



v.'ire 



.i ndo:-; , 



deviation of a score 
from X, where X is an 
EdExAG-group mean f or 
variab le X, and 
number of students. 
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TABLE V-P-4 (continued) 



i 



Variable 



j Sex 
| (gLrl=L;boy=0) 

j Uci Li nation of 
! Objectives 

| Individualization 
; in Dee i s i on Mak ins 

Teacher or Loca 1 Ly 
Deve loped Mater ials 

individual. i nation of 
Inst rue t iona 1 Pace 

Scheduling Charac- 
teristics 

Use of Performance 
Agreements 

Classroom Group 
Or^ani za tion 

Teach in^ I'n i l 
Compos it i en 

Comp Let one s s o f 
Instruct iona I Packa^;< 

U t il iza t [on of 
Student Evaluation 

Level of Innovation 

Decree of Indiv- 
id ua 1 i za t i on 



4 

X 0.50 



Croat fsi 
Ne>;at ive Out 1 i er : 



2 3.00 
9.00 



0 . A 7 0.53 



3.00 3.00' 3.0Q 



I. 00 1.00 1.67 



3.00 2.00 2.00 



.00 2.00 3.00 



Great est 
Pos i t i v<> Out 1 [ t«r^ 



0.46 - 0.56 0.6b 



3.00 1.67 . 3/00 



1 .67 J .00- 1 .00 



2.00 2.00 



3.00 3.00 3.00 



2.00 1 .00 3.00 



1-.50 2.50 2.50 



2.50 2.50 3.00 



3.00 3.00 2.00 



2.00 



22.00 
9.00 



24.17 
9.67 



!.00 



Number of School 180.00 200.00 178.00 

Days pier Year- 



Number of Minutes 
per Day 



60.00 50.00 60.00 ! 



. 50 



3.00 1. .00 1 .00 



2-00 2.00 I. 00 I 2.00 1 .00 ' 1 .00 



3.00 1.00 1.00 



.00 



For binary coded variables the X 'is equal to the 
coded wi til a ' ' L . 



3.00 1.00 1.00 

2.50 1.00 ] .00 

2 . 33 1 . 33 3 . CO 

24.50 1 3.00 U.50 
10.00 4.33 6.00 

200.00 .182.00 200.00 

30.00 50.00 50.00 
,_(eont: i nued) 
propor t ion of st uden Is 
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TABLE V-P-4 (continues 



Var iab Li 



Teacher /S tudo nt 
Contact Ra t io ' 

Numb or of Teachers X 

Teacher's Ago X 



Croat i> st 
Nogn t ivo Out ] i ei> 



3. 03 



37.02 



3. 3 3 

1 .00 
30.00 



4.55 

i 
i 

i.oo ! 

39.17 ! 



Toaehe r r s Soe i o- 
econoni i c . Background 

leach i ng (Jua I i f i - 
oat ions 



X 9 5.29 108.04 102. 1 5 



1 01. 7; 9 3.47 104.96 



f'Tt'.-jt OS I 

J'os ir ivo Our I if 



5.71 



4.00 



3.35 3.70 



1 .01 



36. 00 39.54 



9 1 . 30 



1 .03 
30.-34 
107. 67 



97.40 109.35 103.63 



Tolative measure of teacher/s tudon t contact equal to the percent of teacher 
time per individual student. 



4 7 7 



V-P-l 2 



